-- Logs begin at Thu 2022-05-12 13:40:50 UTC, end at Thu 2022-05-12 14:56:04 UTC. -- May 12 14:16:12.393581 dv-cinder-777031-14-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 12 14:16:12.401674 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 14:16:12 2022] *** May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: nodename: dv-cinder-777031-14-iscsi May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: machine: x86_64 May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: clock source: unix May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: pcre jit disabled May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: detected number of CPU cores: 4 May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: current working directory: / May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: detected binary path: /usr/bin/uwsgi-core May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: your processes number limit is 47680 May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: your memory page size is 4096 bytes May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: detected max file descriptor number: 2048 May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: lock engine: pthread robust mutexes May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: thunder lock: enabled May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 12 14:16:12.406110 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 14:16:12.452354 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: Python main interpreter initialized at 0x55919d25a9c0 May 12 14:16:12.452354 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: python threads support enabled May 12 14:16:12.452354 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: your server socket listen backlog is limited to 100 connections May 12 14:16:12.452354 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: your mercy for graceful operations on workers is 90 seconds May 12 14:16:12.452763 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: mapped 403077 bytes (393 KB) for 2 cores May 12 14:16:12.452839 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: *** Operational MODE: preforking *** May 12 14:16:12.453117 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: *** uWSGI is running in multiple interpreter mode *** May 12 14:16:12.453117 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: spawned uWSGI master process (pid: 79911) May 12 14:16:12.453919 dv-cinder-777031-14-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 12 14:16:12.461749 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: spawned uWSGI worker 1 (pid: 79922, cores: 1) May 12 14:16:12.461749 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: spawned uWSGI worker 2 (pid: 79923, cores: 1) May 12 14:16:12.461749 dv-cinder-777031-14-iscsi devstack@keystone.service[79911]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 14:16:18.221572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:16:18.221572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: from cryptography.utils import int_from_bytes May 12 14:16:18.222827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:16:18.222827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: from cryptography.utils import int_from_bytes May 12 14:16:18.272991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:16:18.273169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:16:18.273369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] command line args: [] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:16:18.273626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:16:18.273803 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ================================================================================ {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:16:18.274057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] admin_token = **** {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.274302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] config_dir = [] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.274492 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.274675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] config_source = [] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.274855 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] debug = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.275068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] list_limit = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] log_config_append = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] log_dir = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] log_file = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.277948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.278280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.278280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.278439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.278680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.278912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.279177 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.279410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.279641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.279889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.280135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.280521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.281002 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.281206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] publish_errors = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.282039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.282254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.282447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.282689 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.282904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.283164 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] standard_threads = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.283397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.283640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.283841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.284032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] use_journal = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.284191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] use_json = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.284320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] use_stderr = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.284484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] use_syslog = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.284682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.284941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.285181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.285443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.285683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.285933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.286171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.286419 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.286656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.286901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.287240 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.287494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.287729 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.287983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.288218 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.288465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.288712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.288947 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.289200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.289452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.289698 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.289934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.290187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.290449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.290701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.290948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.291204 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.291437 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.291667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.291901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.292151 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.292431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.292630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.292859 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.293104 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.293351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.293586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.293831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.294061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.294296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.294529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.294758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.294987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.295242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.295472 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.295707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.296034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.296270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.296506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.296736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.297056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.297304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.297553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.297784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.298025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.298259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.298494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.298729 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.298965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.299205 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.299458 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.299695 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.299933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.300163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.300421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.300657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.300887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.301122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.301358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.301627 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.301865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.302113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.302357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.302593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.302827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.303082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.303457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.303705 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.303948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.304199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.304441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.304680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.304918 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.305157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.305394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.305658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.305902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.306148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.306389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.306634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.306874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.307136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.307376 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.307609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.307845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.308081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.308319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.308551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.308683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:16:18.308683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: from cryptography.utils import int_from_bytes May 12 14:16:18.309299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.309299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.309551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:16:18.309551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: from cryptography.utils import int_from_bytes May 12 14:16:18.309784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.309784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.309784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.310271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.310271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.310515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] auth.external = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.310640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.310926 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.311184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.311401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] auth.password = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.311735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] auth.token = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.312024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.312198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.312446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.313210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.313462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.313710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.313942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.314179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] credential.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.314428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.314677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.314927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.315190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.315438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.315675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.315939 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.316194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.316433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.316685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.316973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.317219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.317485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.317727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.317988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.318224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] federation.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.318459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.318704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.318949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.319224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.319473 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.319712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.319965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.321398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.321398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.321398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.321398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.321398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.321398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.322453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.322453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.322453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.322453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.323194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.323194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.323194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.323795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.323795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.323795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.324320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.324320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.324733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.324733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.325081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.325081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.325446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.325636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.325826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.326016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.326227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.326448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.326686 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.326956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.327338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.327608 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.327774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.328014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.328844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.329109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.329360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.329608 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.329840 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.330079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.330311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.330551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.330788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.331085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.331291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.331528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.331777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.332023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.332253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.332484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.332732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.332979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.333214 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.333449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.333684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.333914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.334154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.334414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.334645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.334891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.335175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.335424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.335660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.335891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.336126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.336362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.336596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.336826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.337071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.337317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.337562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.337809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.338055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.338284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.338533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.338770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.339005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.339265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.339500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.339746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.339994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.340231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.340484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.340714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.340959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.341195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.341430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.341667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.341912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.342153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.342399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.342638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.342965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] resource.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.343256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.343506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.343746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.344019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.344270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.344506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.344752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.344988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.345227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.345462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] role.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.345707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] role.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.345938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.346186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.346433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.346691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.346922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.347205 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.347452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.347698 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.347950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.348184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.348440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.348687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.348934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.349179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.349626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.349865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.350114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.350364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.350612 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.350862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.351123 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.351380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.351633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.351873 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.352106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.352341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.352571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.352821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.353077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.353327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.353564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.353800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.354031 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.354268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] token.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.354503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.354750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.354986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.355289 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.355537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.355777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.356021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.356266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.356512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.356747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.356985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.357218 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.357463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.357709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.357878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:16:18.358018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.358148 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:16:18.358284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.358423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] command line args: [] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:16:18.358603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:16:18.358741 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.358871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ================================================================================ {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:16:18.359001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.connection = **** {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.359199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.359349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] admin_token = **** {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.359490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.359631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] config_dir = [] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.359762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.359905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.360038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.360168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] config_source = [] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.360168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] debug = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.360423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.360553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.360714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.360845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.361065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.361199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.361327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.361465 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.361597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.361733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.361872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.362012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] list_limit = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.362142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.362312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] log_config_append = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.362446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.362576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.362576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] log_dir = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.362832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.362972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] log_file = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.363125 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.363257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.363387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.363528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.363664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.363664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.363913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.364042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.364171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.364312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79922) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:16:18.364443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.364443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.364443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.364443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.364443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.364443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.365463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.365463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.365463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.365823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.365959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.366392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.366582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] publish_errors = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.366822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.367079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.367260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.367505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.367745 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.367985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] standard_threads = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.368228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.368474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.368654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.368834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] use_journal = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.369014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] use_json = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.369192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] use_stderr = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.369370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] use_syslog = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.369606 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:16:18.369867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.370111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.370395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.370641 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.370896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.371179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.371439 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.371683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.371937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.372192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.372448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.372690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.372941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.373183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.373436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.373690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.373932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.374199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.374459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.374710 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.374954 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.375789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.376060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.376321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.376578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.376817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.377056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.377293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.377537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.377794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.378048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.378285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.378781 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.379052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.379321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.379559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.379799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.380041 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.380319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.380501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.380737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.380972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.381208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.381451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.381704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.381940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.382182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.382417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.382658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.382899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.383178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.383427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.383670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.383911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.384151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.384391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.384633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.384868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.385121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.385361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.385605 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.385841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.386106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.386347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.386583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.386826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.387111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.387373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.387620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.387875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.388127 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.388368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.388609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.388855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.389109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.389353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.389594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.389892 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.390252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.390400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.390531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.391445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.391693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.391966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.392213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.392461 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.392706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.392954 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.393198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.393439 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.393681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.393918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.394154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.394390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.394630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.394865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.395149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.395397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.395649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.395794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.395941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.396072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.396205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.396334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.396479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.396611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.397105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] auth.external = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.397344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.397647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.397886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.398121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] auth.password = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.398355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] auth.token = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.398601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.398846 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.399120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.399360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.399613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.399869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.400106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.400347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] credential.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.400598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.400852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.401105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.401346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.401595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.401836 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.402103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.402362 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.402604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.402864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.403178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.403430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.403699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.403962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.404227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.404469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] federation.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.404712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.404964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.405184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.405322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.405468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.405678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.405922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.406183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.410209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.410520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.410796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.411100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.411370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.411649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.411924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.412185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.412444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.412707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.412955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.413210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.413475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.413742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.413989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.414232 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.414569 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.414746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.414949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.417637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.417940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.418227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.418531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.418798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.419080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.419341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.419601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.419850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.420101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.420359 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.420615 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.420878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.421122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.421383 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.421642 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.421938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.422202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.422461 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.422702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.422950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.423215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.423465 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.423712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.423966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.424212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.424458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.424722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.424981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.425221 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.425463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.425721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.425991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.426238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.426485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.426732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.426971 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.427246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.427516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.427757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.428013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.428335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.428521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.428749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.428986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.429228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.429470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.429714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.429951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.430206 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.430459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.430711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.430963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.431244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.431486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.431736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.431978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.432219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.432472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.432716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.432969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.433223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.433466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.433729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.433966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.434216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.434457 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.434705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.434948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.435243 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.435493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.435761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.435974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.436221 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] resource.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.436475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.436729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.436973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.437227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.437484 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.438287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.438541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.438782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.439054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.439300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] role.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.439556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] role.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.439796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.440055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.440312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.440569 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.440823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.441078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.441331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.441583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.441836 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.442076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.442331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.442583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.442835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.443125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.443583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.443825 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.444081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.444337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.444590 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.444845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.445086 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.445352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.445611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.445854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.446091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.446327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.446628 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.446823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.447107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.447365 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.447609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.447852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.448089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.448331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] token.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.448574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.448828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.449071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.449333 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.449585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.449830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.450079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.450327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.450462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.450597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.450728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.450859 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.451120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.451302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.451554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.451808 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.452044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.452297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.452596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.452865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.connection = **** {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.453116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.454010 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.454260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.454523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.454769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.455013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.455283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.455528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.455780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.456025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.456279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.456521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.456776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.457020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.457272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.457508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.457754 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.457995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:16:18.458168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:16:18.485072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.485325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.485464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.494256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.513379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.513604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.521131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.553415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.573749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.573987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.590897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.591231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.643442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.643739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.643903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.644045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.644180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.644312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.644444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.644592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.644728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.644861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.645007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.645007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.668246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.668509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.668702 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.668932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.669156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.669375 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.669595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.671442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.671678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.672424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.672657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.672877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.673093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.673308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.681746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.681990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.695424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.695662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.695886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.696107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.696329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.696537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.696782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79923) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.697172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.697413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.697644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.697875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.698102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.698323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.698539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79922) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 12 14:16:18.715540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.715758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 14:16:18.715914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.716053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 14:16:18.716186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.716318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 14:16:18.716448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.716579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 12 14:16:18.716719 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.716851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.716982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.717114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.717258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.717399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.717532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.717663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.728311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.728595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.728848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.729028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.729166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.729298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.729431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.729574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.737870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.738267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.741136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.741422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.741669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.741826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.741961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.742092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.742225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.742368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.742501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.742641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.742773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.742904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.743069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.743209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.743361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.743502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.743640 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.743778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.743926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.744074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.744213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.744361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.772112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.773726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.774003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.776172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.777831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.778118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.779305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.779582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.779854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.784238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.784523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.784805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.787941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.788222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.792143 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.792430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.792665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.792949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.793226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.793503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.793774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.794046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.794309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.794572 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.797612 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.797919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.798201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.798478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.798753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.799053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.799316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.799585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.817322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.817610 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.821646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.821943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.824006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.826505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.828771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.829068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.830250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.831342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.836215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.836477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.839320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.843005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.843741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.844058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.844339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.844628 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.844908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.845181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.846861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.847186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.847473 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.847759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.848036 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.848315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.864610 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.864895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.865161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.865422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.867788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.868168 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.868443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.868710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.873252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.874955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.875826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.877149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.878851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.879001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.879171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.879303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.879440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.879689 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.880091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.882177 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.882460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.882742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.883053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.883332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.893235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.893509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.893783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.894056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.894341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.894608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.894876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.896757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.897297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.897579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.897869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.898159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.898440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.898726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.914550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.917140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.917816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.920422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.921159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.923903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.924273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.925410 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.925807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.925966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.926120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.927507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.927789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.928086 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.933339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.934946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.940554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.940554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.940913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.940913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.940913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.940913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.941489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.941489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.941489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.941909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.949086 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.949376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.949653 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.950810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.951141 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.951428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.957744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79923) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.958031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.958302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.958567 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.958828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.962774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.963001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79922) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 12 14:16:18.963220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.963220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.963524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.963670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.963827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.963970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.964118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.964118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.964462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.964643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.964792 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.964941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.965088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.965230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.965382 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79923) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.965524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.965524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.965524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.965524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.965524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:18.965524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79922) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 12 14:16:19.000083 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55919d25a9c0 pid: 79923 (default app) May 12 14:16:19.002806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55919d25a9c0 pid: 79922 (default app) May 12 14:16:19.004014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126d2ad-ea1a-4735-a6d5-7ee33e707431 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:19.004315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126d2ad-ea1a-4735-a6d5-7ee33e707431 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:19.004599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126d2ad-ea1a-4735-a6d5-7ee33e707431 None None] PATH_INFO: `/v3` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:19.008808 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 791 bytes} [Thu May 12 14:16:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:27.100233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754e05d-b920-495a-9d79-5b8e8b646c86 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:27.100757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754e05d-b920-495a-9d79-5b8e8b646c86 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:27.100840 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754e05d-b920-495a-9d79-5b8e8b646c86 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:27.105170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1/2] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:27.111541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a622-a1a0-4223-aef6-e72e0c7faac7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:27.112166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a622-a1a0-4223-aef6-e72e0c7faac7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:27.112166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437a622-a1a0-4223-aef6-e72e0c7faac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:27.149330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG oslo_db.sqlalchemy.engines [None req-a437a622-a1a0-4223-aef6-e72e0c7faac7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:16:27.333849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG passlib.handlers.bcrypt [None req-a437a622-a1a0-4223-aef6-e72e0c7faac7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79923) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 14:16:27.334266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG passlib.handlers.bcrypt [None req-a437a622-a1a0-4223-aef6-e72e0c7faac7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79923) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 14:16:27.390412 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a437a622-a1a0-4223-aef6-e72e0c7faac7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:27.392244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a437a622-a1a0-4223-aef6-e72e0c7faac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:27.531703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 2/3] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 14:16:27.728919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754e05d-b920-495a-9d79-5b8e8b646c86 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:27.762593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG oslo_db.sqlalchemy.engines [None req-d754e05d-b920-495a-9d79-5b8e8b646c86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79922) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 12 14:16:27.892291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754e05d-b920-495a-9d79-5b8e8b646c86 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:27.896589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9eb4e-9702-4d0b-b685-00920ceca58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:27.897523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9eb4e-9702-4d0b-b685-00920ceca58e admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:27.897807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9eb4e-9702-4d0b-b685-00920ceca58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:27.898085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9eb4e-9702-4d0b-b685-00920ceca58e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:27.907195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9eb4e-9702-4d0b-b685-00920ceca58e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:27.958966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a6d9eb4e-9702-4d0b-b685-00920ceca58e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 14:16:27.959775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9eb4e-9702-4d0b-b685-00920ceca58e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:27.970747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 2/4] 10.222.0.75 () {58 vars in 1324 bytes} [Thu May 12 14:16:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:16:27.976569 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437a622-a1a0-4223-aef6-e72e0c7faac7 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:27.991637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437a622-a1a0-4223-aef6-e72e0c7faac7 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:27.996032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57628a3-9aba-469a-afcc-364942730d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:27.997153 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57628a3-9aba-469a-afcc-364942730d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:27.997445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57628a3-9aba-469a-afcc-364942730d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:27.997725 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57628a3-9aba-469a-afcc-364942730d55 admin admin] PATH_INFO: `/v3/projects/b51fa73b4d054aee9ce299da7ce9ee7a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:27.999351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57628a3-9aba-469a-afcc-364942730d55 admin admin] RBAC: Authorizing `identity:get_project(project_id=b51fa73b4d054aee9ce299da7ce9ee7a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:28.051809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e57628a3-9aba-469a-afcc-364942730d55 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 12 14:16:28.052161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57628a3-9aba-469a-afcc-364942730d55 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:28.056947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 3/5] 10.222.0.75 () {56 vars in 1207 bytes} [Thu May 12 14:16:27 2022] GET /identity/v3/projects/b51fa73b4d054aee9ce299da7ce9ee7a => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:30.270932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7dc2-b724-42f8-bca4-327322f24a68 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:30.271452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7dc2-b724-42f8-bca4-327322f24a68 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:30.271452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed7dc2-b724-42f8-bca4-327322f24a68 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:30.275902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 3/6] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:16:30.281787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8882e-0efa-485e-83ff-3931c2bda87a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:30.282178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8882e-0efa-485e-83ff-3931c2bda87a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:30.282348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8882e-0efa-485e-83ff-3931c2bda87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:30.300931 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f5b8882e-0efa-485e-83ff-3931c2bda87a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:30.302448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f5b8882e-0efa-485e-83ff-3931c2bda87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:30.310156 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 12 14:16:30.332376 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed7dc2-b724-42f8-bca4-327322f24a68 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:30.345129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed7dc2-b724-42f8-bca4-327322f24a68 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:30.349581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ca2f0-2c02-4d34-b5c6-49278e208354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:30.350239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca2f0-2c02-4d34-b5c6-49278e208354 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:30.350529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca2f0-2c02-4d34-b5c6-49278e208354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:30.350812 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ca2f0-2c02-4d34-b5c6-49278e208354 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:30.359070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ca2f0-2c02-4d34-b5c6-49278e208354 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:30.361581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ca2f0-2c02-4d34-b5c6-49278e208354 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:30.370361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1324 bytes} [Thu May 12 14:16:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:16:30.376248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8882e-0efa-485e-83ff-3931c2bda87a None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:30.385365 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8882e-0efa-485e-83ff-3931c2bda87a None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:30.389690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6998730-4cb9-46ee-ac57-6f8aa4981788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:30.390587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998730-4cb9-46ee-ac57-6f8aa4981788 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:30.390871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998730-4cb9-46ee-ac57-6f8aa4981788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:30.391174 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6998730-4cb9-46ee-ac57-6f8aa4981788 admin admin] PATH_INFO: `/v3/users/7c5460943950426d8cc84743272b5303` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:30.392553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6998730-4cb9-46ee-ac57-6f8aa4981788 admin admin] RBAC: Authorizing `identity:get_user(user_id=7c5460943950426d8cc84743272b5303)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:30.394393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6998730-4cb9-46ee-ac57-6f8aa4981788 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:30.396001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 5/9] 10.222.0.75 () {56 vars in 1198 bytes} [Thu May 12 14:16:30 2022] GET /identity/v3/users/7c5460943950426d8cc84743272b5303 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:32.696179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbc46f-ce6e-476e-a5d3-6152d0d65a6a None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:32.696701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbc46f-ce6e-476e-a5d3-6152d0d65a6a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:32.696807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbc46f-ce6e-476e-a5d3-6152d0d65a6a None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:32.696893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6e99b-69b6-4a56-b878-b94366f07704 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:32.697229 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6e99b-69b6-4a56-b878-b94366f07704 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:32.697430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6e99b-69b6-4a56-b878-b94366f07704 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:32.698080 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 5/10] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:16:32.698765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 6/11] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:16:32.704470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00db2e0-a99e-433d-ad34-0c7f14ba9fae None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:32.704613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3efa9-715d-4744-95d2-27a3a2fdf6fb None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:32.704762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00db2e0-a99e-433d-ad34-0c7f14ba9fae None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:32.704867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3efa9-715d-4744-95d2-27a3a2fdf6fb None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:32.705048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00db2e0-a99e-433d-ad34-0c7f14ba9fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:32.705134 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3efa9-715d-4744-95d2-27a3a2fdf6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:32.721226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-7ff3efa9-715d-4744-95d2-27a3a2fdf6fb None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:32.722406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7ff3efa9-715d-4744-95d2-27a3a2fdf6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:32.743721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG passlib.handlers.bcrypt [None req-c00db2e0-a99e-433d-ad34-0c7f14ba9fae None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79922) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 12 14:16:32.744158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG passlib.handlers.bcrypt [None req-c00db2e0-a99e-433d-ad34-0c7f14ba9fae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79922) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 12 14:16:32.791718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c00db2e0-a99e-433d-ad34-0c7f14ba9fae None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:32.793356 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c00db2e0-a99e-433d-ad34-0c7f14ba9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:32.798620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 7/12] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:32.822037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3efa9-715d-4744-95d2-27a3a2fdf6fb None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:32.893877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 6/13] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:32.917122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00db2e0-a99e-433d-ad34-0c7f14ba9fae None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:32.919480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3efa9-715d-4744-95d2-27a3a2fdf6fb None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:32.952980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0699242-ba84-49dc-9140-e7a624093690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:32.953693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0699242-ba84-49dc-9140-e7a624093690 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:32.953974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0699242-ba84-49dc-9140-e7a624093690 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:32.954247 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0699242-ba84-49dc-9140-e7a624093690 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:32.965323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0699242-ba84-49dc-9140-e7a624093690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-e0699242-ba84-49dc-9140-e7a624093690 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:32.976623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:32.977608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:16:32.978415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 8/14] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:16:32.983716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0699242-ba84-49dc-9140-e7a624093690 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:33.014603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00db2e0-a99e-433d-ad34-0c7f14ba9fae None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:33.046098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc33bf7-1eb8-4c12-8221-9182b8c32275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:33.047551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc33bf7-1eb8-4c12-8221-9182b8c32275 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:33.047834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc33bf7-1eb8-4c12-8221-9182b8c32275 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:33.048109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc33bf7-1eb8-4c12-8221-9182b8c32275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:33.079703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0699242-ba84-49dc-9140-e7a624093690 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:33.111468 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc33bf7-1eb8-4c12-8221-9182b8c32275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:33.112991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc33bf7-1eb8-4c12-8221-9182b8c32275 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:33.113192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a287855-3ec4-4d3f-a865-f1c1f129dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:33.113860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287855-3ec4-4d3f-a865-f1c1f129dc1c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:33.114149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287855-3ec4-4d3f-a865-f1c1f129dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:33.114430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287855-3ec4-4d3f-a865-f1c1f129dc1c None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:33.115227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a287855-3ec4-4d3f-a865-f1c1f129dc1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:33.115544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a287855-3ec4-4d3f-a865-f1c1f129dc1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:33.116936 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a287855-3ec4-4d3f-a865-f1c1f129dc1c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:33.128977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 9/15] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:33.134294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a287855-3ec4-4d3f-a865-f1c1f129dc1c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:33.214804 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 7/16] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:16:33.220906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc33bf7-1eb8-4c12-8221-9182b8c32275 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:33.231311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a287855-3ec4-4d3f-a865-f1c1f129dc1c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:33.263728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb86f5c-3bbf-4b6f-8e97-e26efb110e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:33.264626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb86f5c-3bbf-4b6f-8e97-e26efb110e83 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:33.264901 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb86f5c-3bbf-4b6f-8e97-e26efb110e83 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:33.265183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb86f5c-3bbf-4b6f-8e97-e26efb110e83 None admin] PATH_INFO: `/v3/users/7c5460943950426d8cc84743272b5303` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:33.266384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb86f5c-3bbf-4b6f-8e97-e26efb110e83 None admin] RBAC: Authorizing `identity:get_user(user_id=7c5460943950426d8cc84743272b5303)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:33.267889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb86f5c-3bbf-4b6f-8e97-e26efb110e83 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:33.269511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 10/17] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:33 2022] GET /identity/v3/users/7c5460943950426d8cc84743272b5303 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:33.275019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb86f5c-3bbf-4b6f-8e97-e26efb110e83 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:33.317851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc33bf7-1eb8-4c12-8221-9182b8c32275 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:33.352695 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83230397-7f7f-4f57-90f0-ee5668c501e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:33.353495 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230397-7f7f-4f57-90f0-ee5668c501e1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:33.353781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230397-7f7f-4f57-90f0-ee5668c501e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:33.354058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83230397-7f7f-4f57-90f0-ee5668c501e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:33.371379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb86f5c-3bbf-4b6f-8e97-e26efb110e83 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:33.414811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acde68d-620a-4302-9f40-ab5123865649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:33.415664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde68d-620a-4302-9f40-ab5123865649 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:33.415948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde68d-620a-4302-9f40-ab5123865649 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:33.416224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acde68d-620a-4302-9f40-ab5123865649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:33.417491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acde68d-620a-4302-9f40-ab5123865649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:33.418999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acde68d-620a-4302-9f40-ab5123865649 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:33.420890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 11/18] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:33.426630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acde68d-620a-4302-9f40-ab5123865649 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:33.480490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83230397-7f7f-4f57-90f0-ee5668c501e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:33.481887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83230397-7f7f-4f57-90f0-ee5668c501e1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-83230397-7f7f-4f57-90f0-ee5668c501e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:16:33.503271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:33.504258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:33.505079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:16:33.505079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:16:33.505079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:16:33.505079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:16:33.505079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 8/19] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:16:33.510281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83230397-7f7f-4f57-90f0-ee5668c501e1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:33.527282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acde68d-620a-4302-9f40-ab5123865649 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:33.558573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56116e40-a0d7-4443-bc00-801e149037c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:33.559252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116e40-a0d7-4443-bc00-801e149037c7 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:33.559536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116e40-a0d7-4443-bc00-801e149037c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:33.559813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116e40-a0d7-4443-bc00-801e149037c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:33.560650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56116e40-a0d7-4443-bc00-801e149037c7 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.domain.id=default, user.id=7c5460943950426d8cc84743272b5303) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:33.560960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56116e40-a0d7-4443-bc00-801e149037c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:33.563063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56116e40-a0d7-4443-bc00-801e149037c7 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:33.569702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 12/20] 10.222.0.75 () {56 vars in 1322 bytes} [Thu May 12 14:16:33 2022] GET /identity/v3/role_assignments?user.id=7c5460943950426d8cc84743272b5303&scope.domain.id=default&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:33.609253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83230397-7f7f-4f57-90f0-ee5668c501e1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:33.645386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8cd0d-b59d-481b-8015-024b50e3f148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:33.646074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8cd0d-b59d-481b-8015-024b50e3f148 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:33.646361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8cd0d-b59d-481b-8015-024b50e3f148 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:33.646674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8cd0d-b59d-481b-8015-024b50e3f148 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:33.647710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8cd0d-b59d-481b-8015-024b50e3f148 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:33.648018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8cd0d-b59d-481b-8015-024b50e3f148 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:33.649466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8cd0d-b59d-481b-8015-024b50e3f148 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:33.668435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 9/21] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:36.131966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adf1ba-afc3-4864-8e82-3796b51c0fd8 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:36.133000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adf1ba-afc3-4864-8e82-3796b51c0fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:36.133534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85adf1ba-afc3-4864-8e82-3796b51c0fd8 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:36.135468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 13/22] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:36.141387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb208a1-1d99-42f1-b8ce-62d68658863b None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:36.142314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb208a1-1d99-42f1-b8ce-62d68658863b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:36.142793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb208a1-1d99-42f1-b8ce-62d68658863b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:36.168051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2eb208a1-1d99-42f1-b8ce-62d68658863b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:36.169601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2eb208a1-1d99-42f1-b8ce-62d68658863b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:36.248737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 10/23] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:36.288511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adf1ba-afc3-4864-8e82-3796b51c0fd8 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:36.409072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85adf1ba-afc3-4864-8e82-3796b51c0fd8 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:36.455088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c668dd-f390-4ce3-8a36-fbf2e84c4a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:36.456259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c668dd-f390-4ce3-8a36-fbf2e84c4a40 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:36.456744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c668dd-f390-4ce3-8a36-fbf2e84c4a40 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:36.457220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c668dd-f390-4ce3-8a36-fbf2e84c4a40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:36.474317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c668dd-f390-4ce3-8a36-fbf2e84c4a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-b0c668dd-f390-4ce3-8a36-fbf2e84c4a40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:36.482424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:36.483427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:16:36.484622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:16:36.487258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 14/24] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:16:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:36.493547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb208a1-1d99-42f1-b8ce-62d68658863b None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:36.629182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb208a1-1d99-42f1-b8ce-62d68658863b None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:36.669873 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5394e37-cebf-40d8-a3b7-86ef709828db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:36.671069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5394e37-cebf-40d8-a3b7-86ef709828db None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:36.672369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5394e37-cebf-40d8-a3b7-86ef709828db None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:36.672890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5394e37-cebf-40d8-a3b7-86ef709828db None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:36.673981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5394e37-cebf-40d8-a3b7-86ef709828db None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:36.674526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5394e37-cebf-40d8-a3b7-86ef709828db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:36.676306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5394e37-cebf-40d8-a3b7-86ef709828db None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:36.695961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 11/25] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:36.702301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c668dd-f390-4ce3-8a36-fbf2e84c4a40 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:36.775290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee434c0-5b48-4f68-b03a-b5c7d93164a3 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:36.775919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee434c0-5b48-4f68-b03a-b5c7d93164a3 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:36.776396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee434c0-5b48-4f68-b03a-b5c7d93164a3 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:36.777980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 12/26] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:16:36.783396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d620-b55f-43c7-9350-ee9621d47181 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:36.783951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d620-b55f-43c7-9350-ee9621d47181 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:36.784439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d620-b55f-43c7-9350-ee9621d47181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:36.815567 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-db71d620-b55f-43c7-9350-ee9621d47181 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:36.818570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-db71d620-b55f-43c7-9350-ee9621d47181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:36.842069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c668dd-f390-4ce3-8a36-fbf2e84c4a40 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:36.882731 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543150b-2bd3-4d28-9e8a-b531d69a2511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:36.883949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543150b-2bd3-4d28-9e8a-b531d69a2511 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:36.885471 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543150b-2bd3-4d28-9e8a-b531d69a2511 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:36.885953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543150b-2bd3-4d28-9e8a-b531d69a2511 None admin] PATH_INFO: `/v3/users/7c5460943950426d8cc84743272b5303` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:36.888028 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543150b-2bd3-4d28-9e8a-b531d69a2511 None admin] RBAC: Authorizing `identity:get_user(user_id=7c5460943950426d8cc84743272b5303)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:36.890301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543150b-2bd3-4d28-9e8a-b531d69a2511 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:36.892930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 15/27] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:36 2022] GET /identity/v3/users/7c5460943950426d8cc84743272b5303 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:36.894955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ec881-93ea-48d2-aef6-6214db722930 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:36.896467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ec881-93ea-48d2-aef6-6214db722930 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:36.897609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ec881-93ea-48d2-aef6-6214db722930 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:36.899673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 16/28] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:36.901813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ec881-93ea-48d2-aef6-6214db722930 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:36.966033 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 13/29] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:36.966942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c719de7-9819-44d1-9d0f-875a79d91367 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:36.967280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c719de7-9819-44d1-9d0f-875a79d91367 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:36.967711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c719de7-9819-44d1-9d0f-875a79d91367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:36.986295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-8c719de7-9819-44d1-9d0f-875a79d91367 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:36.987576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8c719de7-9819-44d1-9d0f-875a79d91367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:37.075636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 14/30] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:37.077005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68448aa-6c37-436a-9c83-b75be46433e8 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:37.077362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68448aa-6c37-436a-9c83-b75be46433e8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:37.077642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68448aa-6c37-436a-9c83-b75be46433e8 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:37.083263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 15/31] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:37.084159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68448aa-6c37-436a-9c83-b75be46433e8 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:37.190511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ec881-93ea-48d2-aef6-6214db722930 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:37.203853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68448aa-6c37-436a-9c83-b75be46433e8 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:37.225451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cb2fc-1da8-4a74-b651-3072bb65d158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:37.226497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb2fc-1da8-4a74-b651-3072bb65d158 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:37.226917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb2fc-1da8-4a74-b651-3072bb65d158 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:37.227367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cb2fc-1da8-4a74-b651-3072bb65d158 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:37.228743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cb2fc-1da8-4a74-b651-3072bb65d158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:37.230346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cb2fc-1da8-4a74-b651-3072bb65d158 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:37.237088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 17/32] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:37.238912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8ea3-72f4-4527-ac77-4f069aa007bf None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:37.239364 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8ea3-72f4-4527-ac77-4f069aa007bf None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:37.239898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8ea3-72f4-4527-ac77-4f069aa007bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:37.240495 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155000-1beb-4973-9868-12ad5fe41df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:37.241167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155000-1beb-4973-9868-12ad5fe41df9 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:37.241497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155000-1beb-4973-9868-12ad5fe41df9 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:37.241774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a155000-1beb-4973-9868-12ad5fe41df9 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:37.242843 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a155000-1beb-4973-9868-12ad5fe41df9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:37.244652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a155000-1beb-4973-9868-12ad5fe41df9 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:37.259230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-5cbd8ea3-72f4-4527-ac77-4f069aa007bf None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:37.260730 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5cbd8ea3-72f4-4527-ac77-4f069aa007bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:37.332091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 18/33] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:37.333149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8ea3-72f4-4527-ac77-4f069aa007bf None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:37.383059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 16/34] 10.222.0.75 () {60 vars in 1131 bytes} [Thu May 12 14:16:37 2022] POST /identity/v3/roles => generated 225 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:16:37.383059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155000-1beb-4973-9868-12ad5fe41df9 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:37.488522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8ea3-72f4-4527-ac77-4f069aa007bf None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:37.489386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a155000-1beb-4973-9868-12ad5fe41df9 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:37.532549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d1c69-1ced-4632-a8d1-9dfbcf35c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:37.533467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d1c69-1ced-4632-a8d1-9dfbcf35c862 None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:37.533754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d1c69-1ced-4632-a8d1-9dfbcf35c862 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:37.534042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d1c69-1ced-4632-a8d1-9dfbcf35c862 None admin] PATH_INFO: `/v3/domains/default/users/7c5460943950426d8cc84743272b5303/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:37.538373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d1c69-1ced-4632-a8d1-9dfbcf35c862 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7c5460943950426d8cc84743272b5303, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:37.540045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d1c69-1ced-4632-a8d1-9dfbcf35c862 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:37.562990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e370d5-2909-4a06-9dcc-bdf599e2de15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:37.565902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e370d5-2909-4a06-9dcc-bdf599e2de15 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:37.566875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e370d5-2909-4a06-9dcc-bdf599e2de15 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:37.567194 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e370d5-2909-4a06-9dcc-bdf599e2de15 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:37.569292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e370d5-2909-4a06-9dcc-bdf599e2de15 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:37.573700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 17/35] 10.222.0.75 () {58 vars in 1361 bytes} [Thu May 12 14:16:37 2022] PUT /identity/v3/domains/default/users/7c5460943950426d8cc84743272b5303/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:16:37.574747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d1c69-1ced-4632-a8d1-9dfbcf35c862 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:37.575419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e370d5-2909-4a06-9dcc-bdf599e2de15 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:37.752074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 19/36] 10.222.0.75 () {60 vars in 1131 bytes} [Thu May 12 14:16:37 2022] POST /identity/v3/roles => generated 219 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:16:37.791127 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fccfe-dfd2-4a49-bb05-fe92a8d285bb None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:37.791533 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fccfe-dfd2-4a49-bb05-fe92a8d285bb None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:37.791756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fccfe-dfd2-4a49-bb05-fe92a8d285bb None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:37.793660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 20/37] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:16:37.799041 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1c79-7b81-46b8-8e40-aa671dab8603 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:37.799351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1c79-7b81-46b8-8e40-aa671dab8603 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:37.799622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa1c79-7b81-46b8-8e40-aa671dab8603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:37.819457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d1c69-1ced-4632-a8d1-9dfbcf35c862 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:37.833518 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-81aa1c79-7b81-46b8-8e40-aa671dab8603 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:37.835237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-81aa1c79-7b81-46b8-8e40-aa671dab8603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:37.861845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2162890-a726-45c8-8854-490cbc8096ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:37.862678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2162890-a726-45c8-8854-490cbc8096ee None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:37.862973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2162890-a726-45c8-8854-490cbc8096ee None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:37.863285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2162890-a726-45c8-8854-490cbc8096ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:37.883610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2162890-a726-45c8-8854-490cbc8096ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:37.885183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2162890-a726-45c8-8854-490cbc8096ee None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-a2162890-a726-45c8-8854-490cbc8096ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:16:37.923227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:37.924098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:37.924915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:16:37.924915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:16:37.924915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:16:37.924915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:16:37.927108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 18/38] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:37.929695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 21/39] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:37.933166 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2162890-a726-45c8-8854-490cbc8096ee None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:37.966378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa1c79-7b81-46b8-8e40-aa671dab8603 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:38.046757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2162890-a726-45c8-8854-490cbc8096ee None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:38.081248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa1c79-7b81-46b8-8e40-aa671dab8603 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:38.084606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8cb9f-3ba0-491a-b664-031440007e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:38.085524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8cb9f-3ba0-491a-b664-031440007e87 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:38.086004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8cb9f-3ba0-491a-b664-031440007e87 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:38.086537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8cb9f-3ba0-491a-b664-031440007e87 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:38.087503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8cb9f-3ba0-491a-b664-031440007e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:38.088021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8cb9f-3ba0-491a-b664-031440007e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:38.089637 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8cb9f-3ba0-491a-b664-031440007e87 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:38.103209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 19/40] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:38.112053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8cb9f-3ba0-491a-b664-031440007e87 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:38.118229 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83262c5c-690c-4615-85cd-1f05273ffdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:38.119131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83262c5c-690c-4615-85cd-1f05273ffdf3 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:38.119424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83262c5c-690c-4615-85cd-1f05273ffdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:38.119703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83262c5c-690c-4615-85cd-1f05273ffdf3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:38.121018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83262c5c-690c-4615-85cd-1f05273ffdf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:38.122778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83262c5c-690c-4615-85cd-1f05273ffdf3 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:38.125274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 22/41] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:38.131981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83262c5c-690c-4615-85cd-1f05273ffdf3 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:38.226866 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8cb9f-3ba0-491a-b664-031440007e87 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:38.243464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83262c5c-690c-4615-85cd-1f05273ffdf3 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:38.261526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62945a-6c39-4f38-ba33-25958e713ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:38.262202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62945a-6c39-4f38-ba33-25958e713ff8 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:38.262490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62945a-6c39-4f38-ba33-25958e713ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:38.262771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62945a-6c39-4f38-ba33-25958e713ff8 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:38.263524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62945a-6c39-4f38-ba33-25958e713ff8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:38.265137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62945a-6c39-4f38-ba33-25958e713ff8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:38.278061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814e4a-da80-4ee1-a41a-24842145faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:38.278730 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814e4a-da80-4ee1-a41a-24842145faec None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:38.279014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814e4a-da80-4ee1-a41a-24842145faec None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:38.279324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e814e4a-da80-4ee1-a41a-24842145faec None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:38.280022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e814e4a-da80-4ee1-a41a-24842145faec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:38.281961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e814e4a-da80-4ee1-a41a-24842145faec None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:38.299295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 20/42] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:16:38 2022] POST /identity/v3/projects => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:16:38.300765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed872b-31ec-4d38-adcb-b207e81e3c39 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:38.301058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed872b-31ec-4d38-adcb-b207e81e3c39 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:38.301336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed872b-31ec-4d38-adcb-b207e81e3c39 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:38.302718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 21/43] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:38.314436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0e19-8465-405d-92d4-9eab7252488b None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:38.315062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0e19-8465-405d-92d4-9eab7252488b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:38.315628 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0e19-8465-405d-92d4-9eab7252488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:38.325507 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:16:38 2022] POST /identity/v3/projects => generated 312 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:16:38.360909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-916c0e19-8465-405d-92d4-9eab7252488b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:38.362763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-916c0e19-8465-405d-92d4-9eab7252488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:38.450038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 22/45] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:38.474552 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814e4a-da80-4ee1-a41a-24842145faec None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:38.601512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e814e4a-da80-4ee1-a41a-24842145faec None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:38.636141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334e62c-50e6-4f51-850b-ed210306203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:38.636831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334e62c-50e6-4f51-850b-ed210306203c None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:38.637120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334e62c-50e6-4f51-850b-ed210306203c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:38.637397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334e62c-50e6-4f51-850b-ed210306203c None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:38.638162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334e62c-50e6-4f51-850b-ed210306203c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:38.639672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334e62c-50e6-4f51-850b-ed210306203c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:38.655808 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1131 bytes} [Thu May 12 14:16:38 2022] POST /identity/v3/roles => generated 223 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:16:40.048146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2fdd2-db44-4bf1-b9af-7260861912ee None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:40.048670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2fdd2-db44-4bf1-b9af-7260861912ee None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:40.048742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2fdd2-db44-4bf1-b9af-7260861912ee None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:40.050742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 23/47] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:40.056774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d1fd-7792-4d55-b558-8a8e3e4fc7dd None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:40.057425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d1fd-7792-4d55-b558-8a8e3e4fc7dd None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:40.057425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468d1fd-7792-4d55-b558-8a8e3e4fc7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:40.076011 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-2468d1fd-7792-4d55-b558-8a8e3e4fc7dd None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:40.077280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2468d1fd-7792-4d55-b558-8a8e3e4fc7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:40.149531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 25/48] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:40.172163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2fdd2-db44-4bf1-b9af-7260861912ee None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:40.270493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2fdd2-db44-4bf1-b9af-7260861912ee None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:40.304634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef26d-52c2-40b7-8a91-912f6b32a160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:40.305446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef26d-52c2-40b7-8a91-912f6b32a160 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:40.305734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef26d-52c2-40b7-8a91-912f6b32a160 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:40.306016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef26d-52c2-40b7-8a91-912f6b32a160 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:40.318676 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ef26d-52c2-40b7-8a91-912f6b32a160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-284ef26d-52c2-40b7-8a91-912f6b32a160 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:40.327775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:40.329580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:16:40.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 24/49] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:16:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:40.335569 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d1fd-7792-4d55-b558-8a8e3e4fc7dd None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:40.433118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468d1fd-7792-4d55-b558-8a8e3e4fc7dd None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:40.466511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7989d-48e6-41e9-a2e5-dacc6d19505f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:40.467221 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7989d-48e6-41e9-a2e5-dacc6d19505f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:40.467634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7989d-48e6-41e9-a2e5-dacc6d19505f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:40.467918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7989d-48e6-41e9-a2e5-dacc6d19505f None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:40.468720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7989d-48e6-41e9-a2e5-dacc6d19505f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:40.469025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7989d-48e6-41e9-a2e5-dacc6d19505f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:40.470419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7989d-48e6-41e9-a2e5-dacc6d19505f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:40.478839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 26/50] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:40.484879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef26d-52c2-40b7-8a91-912f6b32a160 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:40.594133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef26d-52c2-40b7-8a91-912f6b32a160 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:40.643963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb20a0a-5a28-4374-becb-a96eeeb469c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:40.644862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb20a0a-5a28-4374-becb-a96eeeb469c5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:40.645153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb20a0a-5a28-4374-becb-a96eeeb469c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:40.645438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb20a0a-5a28-4374-becb-a96eeeb469c5 None admin] PATH_INFO: `/v3/users/7c5460943950426d8cc84743272b5303` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:40.646696 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb20a0a-5a28-4374-becb-a96eeeb469c5 None admin] RBAC: Authorizing `identity:get_user(user_id=7c5460943950426d8cc84743272b5303)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:40.648478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb20a0a-5a28-4374-becb-a96eeeb469c5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:40.650145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 25/51] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:40 2022] GET /identity/v3/users/7c5460943950426d8cc84743272b5303 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:40.656304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7989d-48e6-41e9-a2e5-dacc6d19505f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:40.740916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299073a-9811-4df7-a6b7-e61b11e7c10d None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:40.741218 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299073a-9811-4df7-a6b7-e61b11e7c10d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:40.741499 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299073a-9811-4df7-a6b7-e61b11e7c10d None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:40.742909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 26/52] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:16:40.749070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79634a-54a5-42a4-8c46-a1f73f6aacd5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:40.749367 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79634a-54a5-42a4-8c46-a1f73f6aacd5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:40.749686 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79634a-54a5-42a4-8c46-a1f73f6aacd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:40.761147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7989d-48e6-41e9-a2e5-dacc6d19505f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:40.767548 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-8c79634a-54a5-42a4-8c46-a1f73f6aacd5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:40.768788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8c79634a-54a5-42a4-8c46-a1f73f6aacd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:40.794778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ada9-1369-4a91-85f9-57351f387fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:40.795612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ada9-1369-4a91-85f9-57351f387fe1 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:40.795900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ada9-1369-4a91-85f9-57351f387fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:40.796179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205ada9-1369-4a91-85f9-57351f387fe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:40.797956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205ada9-1369-4a91-85f9-57351f387fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:40.799455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205ada9-1369-4a91-85f9-57351f387fe1 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:40.801377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 27/53] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:40.807135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ada9-1369-4a91-85f9-57351f387fe1 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:40.844128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 27/54] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:40.867810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79634a-54a5-42a4-8c46-a1f73f6aacd5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:40.922197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205ada9-1369-4a91-85f9-57351f387fe1 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:40.977519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9455786-5853-4e03-9ff3-74535ac3ed01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:40.977519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9455786-5853-4e03-9ff3-74535ac3ed01 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:40.977519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9455786-5853-4e03-9ff3-74535ac3ed01 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:40.977519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9455786-5853-4e03-9ff3-74535ac3ed01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:40.977952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9455786-5853-4e03-9ff3-74535ac3ed01 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.domain.id=default, user.id=7c5460943950426d8cc84743272b5303) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:40.977952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9455786-5853-4e03-9ff3-74535ac3ed01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:40.979118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9455786-5853-4e03-9ff3-74535ac3ed01 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:40.984191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79634a-54a5-42a4-8c46-a1f73f6aacd5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:40.985544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 28/55] 10.222.0.75 () {56 vars in 1322 bytes} [Thu May 12 14:16:40 2022] GET /identity/v3/role_assignments?user.id=7c5460943950426d8cc84743272b5303&scope.domain.id=default&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 530 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:41.028618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc9af2-52d9-4620-9bc7-0b8fca1b9c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:41.029448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc9af2-52d9-4620-9bc7-0b8fca1b9c61 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:41.029733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc9af2-52d9-4620-9bc7-0b8fca1b9c61 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:41.030012 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc9af2-52d9-4620-9bc7-0b8fca1b9c61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:41.031493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc9af2-52d9-4620-9bc7-0b8fca1b9c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:41.033015 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fc9af2-52d9-4620-9bc7-0b8fca1b9c61 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:41.034969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 28/56] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:41.040742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9455786-5853-4e03-9ff3-74535ac3ed01 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:41.155599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9455786-5853-4e03-9ff3-74535ac3ed01 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:41.193113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044d183-403c-47b5-8e51-bf18c9554385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:41.193794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044d183-403c-47b5-8e51-bf18c9554385 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:41.194087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044d183-403c-47b5-8e51-bf18c9554385 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:41.194376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044d183-403c-47b5-8e51-bf18c9554385 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:41.195197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044d183-403c-47b5-8e51-bf18c9554385 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:41.196985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044d183-403c-47b5-8e51-bf18c9554385 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:41.224817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 29/57] 10.222.0.75 () {60 vars in 1140 bytes} [Thu May 12 14:16:41 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:16:43.618836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4319354-309b-423e-b868-24819fdeb45a None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:43.619430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4319354-309b-423e-b868-24819fdeb45a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:43.619430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4319354-309b-423e-b868-24819fdeb45a None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:43.620785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 29/58] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:43.626512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3a8db-f191-4671-98d8-8d93b07a7ea9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:43.626894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3a8db-f191-4671-98d8-8d93b07a7ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:43.627114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3a8db-f191-4671-98d8-8d93b07a7ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:43.643392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a2f3a8db-f191-4671-98d8-8d93b07a7ea9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:43.644619 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a2f3a8db-f191-4671-98d8-8d93b07a7ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:43.708827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 30/59] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:43.733247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4319354-309b-423e-b868-24819fdeb45a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:43.835909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4319354-309b-423e-b868-24819fdeb45a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:43.869801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2fcf90-015a-46f4-b2f0-67f623980355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:43.870518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fcf90-015a-46f4-b2f0-67f623980355 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:43.870799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fcf90-015a-46f4-b2f0-67f623980355 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:43.871097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2fcf90-015a-46f4-b2f0-67f623980355 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:43.872286 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fcf90-015a-46f4-b2f0-67f623980355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:43.873731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2fcf90-015a-46f4-b2f0-67f623980355 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:43.875468 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 30/60] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:43.881003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3a8db-f191-4671-98d8-8d93b07a7ea9 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:43.976876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3a8db-f191-4671-98d8-8d93b07a7ea9 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:44.011678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce74c3-1351-47ef-875e-f807320e6c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:44.012357 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce74c3-1351-47ef-875e-f807320e6c3e None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:44.012646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce74c3-1351-47ef-875e-f807320e6c3e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:44.012926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce74c3-1351-47ef-875e-f807320e6c3e None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:44.013650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce74c3-1351-47ef-875e-f807320e6c3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:44.015142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce74c3-1351-47ef-875e-f807320e6c3e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:44.041138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 31/61] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:16:43 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:16:47.579879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa1c1a-5797-4338-b8e6-d3b3eccb3a82 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:47.580397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa1c1a-5797-4338-b8e6-d3b3eccb3a82 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:47.580471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa1c1a-5797-4338-b8e6-d3b3eccb3a82 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:47.582052 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 31/62] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:47.587721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2197ab-4902-44f7-a502-497770adfbaa None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:47.588197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2197ab-4902-44f7-a502-497770adfbaa None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:47.588298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2197ab-4902-44f7-a502-497770adfbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:47.615625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-bd2197ab-4902-44f7-a502-497770adfbaa None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:47.616868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-bd2197ab-4902-44f7-a502-497770adfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:47.717085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 32/63] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:47.752670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa1c1a-5797-4338-b8e6-d3b3eccb3a82 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:47.790002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668717-69b8-4980-95a9-aadb0966e3b2 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:47.790631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668717-69b8-4980-95a9-aadb0966e3b2 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:47.791147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e668717-69b8-4980-95a9-aadb0966e3b2 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:47.792950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 33/64] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:47.799302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26127bd-0151-46ea-ae74-1f57a39d8b16 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:47.799911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26127bd-0151-46ea-ae74-1f57a39d8b16 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:47.800447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26127bd-0151-46ea-ae74-1f57a39d8b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:47.834335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f26127bd-0151-46ea-ae74-1f57a39d8b16 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:47.835529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f26127bd-0151-46ea-ae74-1f57a39d8b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:47.884717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa1c1a-5797-4338-b8e6-d3b3eccb3a82 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:47.921027 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8ae9-b144-4df9-a8ce-6533a02d2d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:47.922642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8ae9-b144-4df9-a8ce-6533a02d2d52 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:47.923099 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8ae9-b144-4df9-a8ce-6533a02d2d52 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:47.923521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b8ae9-b144-4df9-a8ce-6533a02d2d52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:47.926427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 34/65] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:47.928128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d8f93-9242-4d44-b230-d9a6368a1b87 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:47.928630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d8f93-9242-4d44-b230-d9a6368a1b87 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:47.929114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d8f93-9242-4d44-b230-d9a6368a1b87 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:47.934522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b8ae9-b144-4df9-a8ce-6533a02d2d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:47.940046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 35/66] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:47.941699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c6f4a-5b60-4736-b984-14cc0da821d4 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:47.942091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c6f4a-5b60-4736-b984-14cc0da821d4 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:47.942584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c6f4a-5b60-4736-b984-14cc0da821d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-f67b8ae9-b144-4df9-a8ce-6533a02d2d52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:47.942830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:47.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:16:47.944532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 32/67] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:47.949652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8ae9-b144-4df9-a8ce-6533a02d2d52 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:47.970889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-4b9c6f4a-5b60-4736-b984-14cc0da821d4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:47.972568 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4b9c6f4a-5b60-4736-b984-14cc0da821d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:48.052765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 36/68] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:48.059164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c6f4a-5b60-4736-b984-14cc0da821d4 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:48.067303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b8ae9-b144-4df9-a8ce-6533a02d2d52 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:48.102802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967760df-522d-479f-816d-fd699cd1665d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:48.103434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967760df-522d-479f-816d-fd699cd1665d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.103812 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967760df-522d-479f-816d-fd699cd1665d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.104271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967760df-522d-479f-816d-fd699cd1665d None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.105620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967760df-522d-479f-816d-fd699cd1665d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:48.106179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967760df-522d-479f-816d-fd699cd1665d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:48.108771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967760df-522d-479f-816d-fd699cd1665d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:48.120225 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 33/69] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:48.125142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce8d6-4217-4877-8440-28d4b98df4f2 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.125591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce8d6-4217-4877-8440-28d4b98df4f2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.125885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ce8d6-4217-4877-8440-28d4b98df4f2 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.127423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 34/70] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:48.132259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce8d6-4217-4877-8440-28d4b98df4f2 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:48.168318 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c6f4a-5b60-4736-b984-14cc0da821d4 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:48.203259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0d493-d205-4280-9198-615b37721283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:48.204179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0d493-d205-4280-9198-615b37721283 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.204466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0d493-d205-4280-9198-615b37721283 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.204743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0d493-d205-4280-9198-615b37721283 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.214789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0d493-d205-4280-9198-615b37721283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-79c0d493-d205-4280-9198-615b37721283 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:48.223481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:48.224402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:16:48.225159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 37/71] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:48.226308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0d493-d205-4280-9198-615b37721283 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:48.242748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ce8d6-4217-4877-8440-28d4b98df4f2 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:48.276740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4d7a5-5dc0-4499-a6f2-a1f8808b0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:48.277573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d7a5-5dc0-4499-a6f2-a1f8808b0431 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.277856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d7a5-5dc0-4499-a6f2-a1f8808b0431 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.278133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4d7a5-5dc0-4499-a6f2-a1f8808b0431 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.289485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4d7a5-5dc0-4499-a6f2-a1f8808b0431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-47d4d7a5-5dc0-4499-a6f2-a1f8808b0431 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:48.298046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:48.298943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:16:48.299747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 35/72] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:16:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:48.300930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6e28b-2791-4c3c-9876-13cb81b3d263 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.301072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6e28b-2791-4c3c-9876-13cb81b3d263 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.301237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6e28b-2791-4c3c-9876-13cb81b3d263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.318360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b4a6e28b-2791-4c3c-9876-13cb81b3d263 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:48.319617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b4a6e28b-2791-4c3c-9876-13cb81b3d263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:48.327622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0d493-d205-4280-9198-615b37721283 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:48.365113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74098f3a-9d1e-4a06-8e89-481099654be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:48.365923 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74098f3a-9d1e-4a06-8e89-481099654be5 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.366215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74098f3a-9d1e-4a06-8e89-481099654be5 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.366498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74098f3a-9d1e-4a06-8e89-481099654be5 None admin] PATH_INFO: `/v3/users/7c5460943950426d8cc84743272b5303` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.367846 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74098f3a-9d1e-4a06-8e89-481099654be5 None admin] RBAC: Authorizing `identity:get_user(user_id=7c5460943950426d8cc84743272b5303)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:48.369416 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74098f3a-9d1e-4a06-8e89-481099654be5 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:48.371107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 38/73] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:48 2022] GET /identity/v3/users/7c5460943950426d8cc84743272b5303 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:48.372355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d1d6d-a5e8-44c6-aa06-a449ae9f209d None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.372642 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d1d6d-a5e8-44c6-aa06-a449ae9f209d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.372921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d1d6d-a5e8-44c6-aa06-a449ae9f209d None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.375794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 39/74] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:48.375794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d1d6d-a5e8-44c6-aa06-a449ae9f209d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:48.389841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 36/75] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:48.390781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6e28b-2791-4c3c-9876-13cb81b3d263 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:48.484528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d1d6d-a5e8-44c6-aa06-a449ae9f209d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:48.496429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6e28b-2791-4c3c-9876-13cb81b3d263 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:48.517988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424ad1d-2fcf-4396-a1b5-4e25123f9606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:48.518674 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424ad1d-2fcf-4396-a1b5-4e25123f9606 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.518957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424ad1d-2fcf-4396-a1b5-4e25123f9606 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.519268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424ad1d-2fcf-4396-a1b5-4e25123f9606 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.520031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424ad1d-2fcf-4396-a1b5-4e25123f9606 None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:48.520344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424ad1d-2fcf-4396-a1b5-4e25123f9606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:48.522004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424ad1d-2fcf-4396-a1b5-4e25123f9606 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:48.534497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 40/76] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:16:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:48.535414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424ad1d-2fcf-4396-a1b5-4e25123f9606 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:48.546170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efde3b8-a184-4be9-9f30-2bda402e4443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:48.546888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde3b8-a184-4be9-9f30-2bda402e4443 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.547211 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde3b8-a184-4be9-9f30-2bda402e4443 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.547484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde3b8-a184-4be9-9f30-2bda402e4443 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.548247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde3b8-a184-4be9-9f30-2bda402e4443 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:48.548551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde3b8-a184-4be9-9f30-2bda402e4443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:48.549963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde3b8-a184-4be9-9f30-2bda402e4443 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:48.558448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 37/77] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:16:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:48.559714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098bee-4d03-4d36-b77d-3c7993feeb10 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.560012 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098bee-4d03-4d36-b77d-3c7993feeb10 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.560290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c098bee-4d03-4d36-b77d-3c7993feeb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.577743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-0c098bee-4d03-4d36-b77d-3c7993feeb10 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:48.579508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0c098bee-4d03-4d36-b77d-3c7993feeb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:48.641094 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424ad1d-2fcf-4396-a1b5-4e25123f9606 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:48.646176 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 38/78] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:48.647108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098bee-4d03-4d36-b77d-3c7993feeb10 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:48.681166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd050fa-c0d4-44cd-8bac-71c85802d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:48.681827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd050fa-c0d4-44cd-8bac-71c85802d3db None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.682119 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd050fa-c0d4-44cd-8bac-71c85802d3db None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.682403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd050fa-c0d4-44cd-8bac-71c85802d3db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.748797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd050fa-c0d4-44cd-8bac-71c85802d3db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:48.750947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd050fa-c0d4-44cd-8bac-71c85802d3db None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:48.754201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c098bee-4d03-4d36-b77d-3c7993feeb10 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:48.789707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b78e1-a877-4f55-bf7a-48a7180ee5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:48.790510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b78e1-a877-4f55-bf7a-48a7180ee5bc None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.790797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b78e1-a877-4f55-bf7a-48a7180ee5bc None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.791100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b78e1-a877-4f55-bf7a-48a7180ee5bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.792367 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b78e1-a877-4f55-bf7a-48a7180ee5bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:48.793832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b78e1-a877-4f55-bf7a-48a7180ee5bc None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:48.795512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 39/79] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:48.796297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b78e1-a877-4f55-bf7a-48a7180ee5bc None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:48.863432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 41/80] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:16:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:16:48.864099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd050fa-c0d4-44cd-8bac-71c85802d3db None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:48.896025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b78e1-a877-4f55-bf7a-48a7180ee5bc None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:48.929014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba89371-ca81-4a14-bbd3-277fe47bd83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:48.929888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba89371-ca81-4a14-bbd3-277fe47bd83c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.930170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba89371-ca81-4a14-bbd3-277fe47bd83c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.930443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba89371-ca81-4a14-bbd3-277fe47bd83c None admin] PATH_INFO: `/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.946805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba89371-ca81-4a14-bbd3-277fe47bd83c None admin] RBAC: Authorizing `identity:get_user(user_id=bf02ab5a7b8c4c06b4049a6a200a1195)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:48.948277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba89371-ca81-4a14-bbd3-277fe47bd83c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:48.950020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 40/81] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:48 2022] GET /identity/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:48.950801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba89371-ca81-4a14-bbd3-277fe47bd83c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:48.963539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd050fa-c0d4-44cd-8bac-71c85802d3db None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:48.996335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45374fc-792e-4f43-9659-b069bd5780ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:48.997209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45374fc-792e-4f43-9659-b069bd5780ce None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:48.997493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45374fc-792e-4f43-9659-b069bd5780ce None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:48.997768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45374fc-792e-4f43-9659-b069bd5780ce None admin] PATH_INFO: `/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:48.999332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45374fc-792e-4f43-9659-b069bd5780ce None admin] RBAC: Authorizing `identity:get_user(user_id=bf02ab5a7b8c4c06b4049a6a200a1195)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:49.001094 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45374fc-792e-4f43-9659-b069bd5780ce None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:49.002767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 42/82] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:48 2022] GET /identity/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:49.007300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45374fc-792e-4f43-9659-b069bd5780ce None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:49.063508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba89371-ca81-4a14-bbd3-277fe47bd83c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:49.096874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b676ce-d97d-45f7-bb6e-85a299f5d626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:49.099531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b676ce-d97d-45f7-bb6e-85a299f5d626 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:49.099531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b676ce-d97d-45f7-bb6e-85a299f5d626 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:49.099531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b676ce-d97d-45f7-bb6e-85a299f5d626 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:49.106630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45374fc-792e-4f43-9659-b069bd5780ce None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:49.108870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b676ce-d97d-45f7-bb6e-85a299f5d626 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-37b676ce-d97d-45f7-bb6e-85a299f5d626 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:49.120361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:49.121236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:16:49.121994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:16:49.122575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 41/83] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:49.123611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b676ce-d97d-45f7-bb6e-85a299f5d626 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:49.141281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47d989-7229-4aad-8f64-7ed862f5ce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:49.141966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47d989-7229-4aad-8f64-7ed862f5ce7f None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:49.142261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47d989-7229-4aad-8f64-7ed862f5ce7f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:49.142544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47d989-7229-4aad-8f64-7ed862f5ce7f None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:49.143297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47d989-7229-4aad-8f64-7ed862f5ce7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:49.144799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47d989-7229-4aad-8f64-7ed862f5ce7f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:49.166420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 43/84] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:16:49 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:16:49.167262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47d989-7229-4aad-8f64-7ed862f5ce7f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:49.260152 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b676ce-d97d-45f7-bb6e-85a299f5d626 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:49.285959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47d989-7229-4aad-8f64-7ed862f5ce7f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:49.299234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980c7b7-9ecb-49a6-b920-e6fe35c9e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:49.300129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c7b7-9ecb-49a6-b920-e6fe35c9e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:49.300414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c7b7-9ecb-49a6-b920-e6fe35c9e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:49.300691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980c7b7-9ecb-49a6-b920-e6fe35c9e9c8 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:49.301986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980c7b7-9ecb-49a6-b920-e6fe35c9e9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:49.303535 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980c7b7-9ecb-49a6-b920-e6fe35c9e9c8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:49.305333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 42/85] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:16:49 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:49.306162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980c7b7-9ecb-49a6-b920-e6fe35c9e9c8 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:49.328889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc7a34-18b0-479e-ba2c-ced8c78a2f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:49.329582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc7a34-18b0-479e-ba2c-ced8c78a2f82 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:49.329849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc7a34-18b0-479e-ba2c-ced8c78a2f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:49.330125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc7a34-18b0-479e-ba2c-ced8c78a2f82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:49.403282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc7a34-18b0-479e-ba2c-ced8c78a2f82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:49.405030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc7a34-18b0-479e-ba2c-ced8c78a2f82 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:49.427427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980c7b7-9ecb-49a6-b920-e6fe35c9e9c8 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:49.470828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac330973-cdb6-486c-8036-ef65076f3162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:49.471548 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac330973-cdb6-486c-8036-ef65076f3162 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:49.471841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac330973-cdb6-486c-8036-ef65076f3162 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:49.472126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac330973-cdb6-486c-8036-ef65076f3162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:49.516627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 44/86] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:16:49.517576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc7a34-18b0-479e-ba2c-ced8c78a2f82 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:49.558719 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac330973-cdb6-486c-8036-ef65076f3162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:49.560250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac330973-cdb6-486c-8036-ef65076f3162 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:49.629830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc7a34-18b0-479e-ba2c-ced8c78a2f82 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:49.664473 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 43/87] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:16:49.665361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac330973-cdb6-486c-8036-ef65076f3162 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:49.675796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806d9b4-58e1-4544-a854-b739f0ee9a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:49.676534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806d9b4-58e1-4544-a854-b739f0ee9a3e None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:49.676822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806d9b4-58e1-4544-a854-b739f0ee9a3e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:49.677156 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806d9b4-58e1-4544-a854-b739f0ee9a3e None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:49.677979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806d9b4-58e1-4544-a854-b739f0ee9a3e None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:49.678238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806d9b4-58e1-4544-a854-b739f0ee9a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:49.679758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806d9b4-58e1-4544-a854-b739f0ee9a3e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:49.688932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 45/88] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:16:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:49.689789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806d9b4-58e1-4544-a854-b739f0ee9a3e None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:49.773249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac330973-cdb6-486c-8036-ef65076f3162 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:49.809758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b74e3-0352-41a2-bcbf-d4328bc1c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:49.810428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b74e3-0352-41a2-bcbf-d4328bc1c38f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:49.810712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b74e3-0352-41a2-bcbf-d4328bc1c38f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:49.811016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806d9b4-58e1-4544-a854-b739f0ee9a3e None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:49.811145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b74e3-0352-41a2-bcbf-d4328bc1c38f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:49.811993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b74e3-0352-41a2-bcbf-d4328bc1c38f None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=540bf727f064487c930910ee34bc6da0, user.id=7c5460943950426d8cc84743272b5303) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:49.812313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b74e3-0352-41a2-bcbf-d4328bc1c38f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:49.813796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b74e3-0352-41a2-bcbf-d4328bc1c38f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:49.823891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 44/89] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:16:49 2022] GET /identity/v3/role_assignments?user.id=7c5460943950426d8cc84743272b5303&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:49.824775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b74e3-0352-41a2-bcbf-d4328bc1c38f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:49.867524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92f9ee-247a-4fc6-a838-93638693ec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:49.868430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92f9ee-247a-4fc6-a838-93638693ec50 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:49.868721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92f9ee-247a-4fc6-a838-93638693ec50 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:49.869006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92f9ee-247a-4fc6-a838-93638693ec50 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:49.870375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92f9ee-247a-4fc6-a838-93638693ec50 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:49.872033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc92f9ee-247a-4fc6-a838-93638693ec50 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:49.875581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 46/90] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:16:49 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:49.877176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92f9ee-247a-4fc6-a838-93638693ec50 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:49.934430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b74e3-0352-41a2-bcbf-d4328bc1c38f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:49.975484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57e31c-738e-4515-b1b8-647bb75e22cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:49.976477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57e31c-738e-4515-b1b8-647bb75e22cf None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:49.976761 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57e31c-738e-4515-b1b8-647bb75e22cf None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:49.977035 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57e31c-738e-4515-b1b8-647bb75e22cf None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:49.979363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57e31c-738e-4515-b1b8-647bb75e22cf None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:49.980853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57e31c-738e-4515-b1b8-647bb75e22cf None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:49.983510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 45/91] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:16:49 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:49.986438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57e31c-738e-4515-b1b8-647bb75e22cf None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:50.030210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92f9ee-247a-4fc6-a838-93638693ec50 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:50.098942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b462811-a48a-476b-8226-dfd0b5f1b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:50.102834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462811-a48a-476b-8226-dfd0b5f1b211 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:50.103185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462811-a48a-476b-8226-dfd0b5f1b211 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:50.103478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462811-a48a-476b-8226-dfd0b5f1b211 None admin] PATH_INFO: `/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:50.106271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b462811-a48a-476b-8226-dfd0b5f1b211 None admin] RBAC: Authorizing `identity:get_user(user_id=bf02ab5a7b8c4c06b4049a6a200a1195)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:50.111399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b462811-a48a-476b-8226-dfd0b5f1b211 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:50.114800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 47/92] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:49 2022] GET /identity/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:50.116036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b462811-a48a-476b-8226-dfd0b5f1b211 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:50.126112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57e31c-738e-4515-b1b8-647bb75e22cf None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:50.185687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6018-48a0-496e-9e30-5705d3e7016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:50.185687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6018-48a0-496e-9e30-5705d3e7016b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:50.185687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6018-48a0-496e-9e30-5705d3e7016b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:50.185687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b6018-48a0-496e-9e30-5705d3e7016b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:50.186278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b6018-48a0-496e-9e30-5705d3e7016b None admin] RBAC: Adding query filter params (role.id=2d441060f04441848c895dc5b9affb06, scope.project.id=540bf727f064487c930910ee34bc6da0, user.id=bf02ab5a7b8c4c06b4049a6a200a1195) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:50.186544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b6018-48a0-496e-9e30-5705d3e7016b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:50.188382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b6018-48a0-496e-9e30-5705d3e7016b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:50.194305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 46/93] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:16:49 2022] GET /identity/v3/role_assignments?user.id=bf02ab5a7b8c4c06b4049a6a200a1195&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=2d441060f04441848c895dc5b9affb06 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:50.195168 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6018-48a0-496e-9e30-5705d3e7016b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:50.301422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b462811-a48a-476b-8226-dfd0b5f1b211 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:50.351885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32611a-8a9a-4472-8d0a-bcc464ad1173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:50.352568 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32611a-8a9a-4472-8d0a-bcc464ad1173 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:50.352862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32611a-8a9a-4472-8d0a-bcc464ad1173 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:50.353144 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32611a-8a9a-4472-8d0a-bcc464ad1173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:50.354112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32611a-8a9a-4472-8d0a-bcc464ad1173 None admin] RBAC: Adding query filter params (role.id=8b437ce0fad84637a68c6c151d4e2c5c, scope.project.id=540bf727f064487c930910ee34bc6da0, user.id=bf02ab5a7b8c4c06b4049a6a200a1195) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:50.354318 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32611a-8a9a-4472-8d0a-bcc464ad1173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:50.356249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32611a-8a9a-4472-8d0a-bcc464ad1173 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:50.361449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b6018-48a0-496e-9e30-5705d3e7016b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:50.373655 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 48/94] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:16:50 2022] GET /identity/v3/role_assignments?user.id=bf02ab5a7b8c4c06b4049a6a200a1195&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=8b437ce0fad84637a68c6c151d4e2c5c => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:50.402890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90cb2-e077-41e9-bf3e-c13fd3c4cebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:50.403617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90cb2-e077-41e9-bf3e-c13fd3c4cebf None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:50.403912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90cb2-e077-41e9-bf3e-c13fd3c4cebf None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:50.404202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a90cb2-e077-41e9-bf3e-c13fd3c4cebf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:50.526971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a90cb2-e077-41e9-bf3e-c13fd3c4cebf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:50.529036 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a90cb2-e077-41e9-bf3e-c13fd3c4cebf None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:50.666434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 47/95] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:16:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:16:50.673291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32611a-8a9a-4472-8d0a-bcc464ad1173 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:50.822417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32611a-8a9a-4472-8d0a-bcc464ad1173 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:50.860249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d3960-55c6-40f2-a0f5-61cc4245b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:50.861634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d3960-55c6-40f2-a0f5-61cc4245b22c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:50.861919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d3960-55c6-40f2-a0f5-61cc4245b22c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:50.862253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d3960-55c6-40f2-a0f5-61cc4245b22c None admin] PATH_INFO: `/v3/projects/d1245c6793dc4fe5ac304eb7d9b09d36` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:50.863595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d3960-55c6-40f2-a0f5-61cc4245b22c None admin] RBAC: Authorizing `identity:get_project(project_id=d1245c6793dc4fe5ac304eb7d9b09d36)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:50.865150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d3960-55c6-40f2-a0f5-61cc4245b22c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:50.867021 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 49/96] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:16:50 2022] GET /identity/v3/projects/d1245c6793dc4fe5ac304eb7d9b09d36 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:50.873059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90cb2-e077-41e9-bf3e-c13fd3c4cebf None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:51.020028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a90cb2-e077-41e9-bf3e-c13fd3c4cebf None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:51.081163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cab8a-decb-4f2c-852f-1a349848e89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:51.082220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cab8a-decb-4f2c-852f-1a349848e89e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:51.082706 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cab8a-decb-4f2c-852f-1a349848e89e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:51.083337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cab8a-decb-4f2c-852f-1a349848e89e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:51.085002 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cab8a-decb-4f2c-852f-1a349848e89e None admin] RBAC: Adding query filter params (role.id=2d441060f04441848c895dc5b9affb06, scope.project.id=d1245c6793dc4fe5ac304eb7d9b09d36, user.id=bf02ab5a7b8c4c06b4049a6a200a1195) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:51.085562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cab8a-decb-4f2c-852f-1a349848e89e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:51.088357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cab8a-decb-4f2c-852f-1a349848e89e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:51.103670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 48/97] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:16:50 2022] GET /identity/v3/role_assignments?user.id=bf02ab5a7b8c4c06b4049a6a200a1195&scope.project.id=d1245c6793dc4fe5ac304eb7d9b09d36&role.id=2d441060f04441848c895dc5b9affb06 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:52.498765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1b46b-530a-4a4e-bdf6-c2564358cef7 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:52.501779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1b46b-530a-4a4e-bdf6-c2564358cef7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:52.502320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1b46b-530a-4a4e-bdf6-c2564358cef7 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:52.504020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 50/98] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:52.509916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb62f7d-8051-4dd2-81b0-99f04170663e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:52.510794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb62f7d-8051-4dd2-81b0-99f04170663e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:52.511321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb62f7d-8051-4dd2-81b0-99f04170663e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:52.529429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-fbb62f7d-8051-4dd2-81b0-99f04170663e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:52.531823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-fbb62f7d-8051-4dd2-81b0-99f04170663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:52.602533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 49/99] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:52.629448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1b46b-530a-4a4e-bdf6-c2564358cef7 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:52.755881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1b46b-530a-4a4e-bdf6-c2564358cef7 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:52.798080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b0d0d-e5f2-4b7a-b8dc-31a727d09de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:52.799278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b0d0d-e5f2-4b7a-b8dc-31a727d09de6 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:52.799871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b0d0d-e5f2-4b7a-b8dc-31a727d09de6 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:52.800531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b0d0d-e5f2-4b7a-b8dc-31a727d09de6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:52.822089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b0d0d-e5f2-4b7a-b8dc-31a727d09de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-2b4b0d0d-e5f2-4b7a-b8dc-31a727d09de6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:52.832301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:52.833248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:16:52.834040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:16:52.836620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 51/100] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:16:52.838664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5891b3-80f1-4fcc-9bb1-219989682ae1 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:52.839210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5891b3-80f1-4fcc-9bb1-219989682ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:52.839712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5891b3-80f1-4fcc-9bb1-219989682ae1 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:52.841278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 50/101] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:16:52.848102 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b0d0d-e5f2-4b7a-b8dc-31a727d09de6 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:52.864428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363214f2-3925-4171-8621-da0627a00e5c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:52.865068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363214f2-3925-4171-8621-da0627a00e5c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:52.865558 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363214f2-3925-4171-8621-da0627a00e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:52.888597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-363214f2-3925-4171-8621-da0627a00e5c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:52.893703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-363214f2-3925-4171-8621-da0627a00e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:53.022341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b0d0d-e5f2-4b7a-b8dc-31a727d09de6 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:53.049674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 51/102] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:53.078456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83912df0-9e5c-4b87-be7d-1f9109d7a593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:53.079162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912df0-9e5c-4b87-be7d-1f9109d7a593 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:53.079454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912df0-9e5c-4b87-be7d-1f9109d7a593 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:53.079735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83912df0-9e5c-4b87-be7d-1f9109d7a593 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:53.080499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83912df0-9e5c-4b87-be7d-1f9109d7a593 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:53.080810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83912df0-9e5c-4b87-be7d-1f9109d7a593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:53.082569 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83912df0-9e5c-4b87-be7d-1f9109d7a593 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:53.089556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363214f2-3925-4171-8621-da0627a00e5c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:53.105753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 52/103] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:16:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:53.111565 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83912df0-9e5c-4b87-be7d-1f9109d7a593 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:53.286585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363214f2-3925-4171-8621-da0627a00e5c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:53.293394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83912df0-9e5c-4b87-be7d-1f9109d7a593 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:53.336490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51a73d-735d-49b3-b3dc-059e49cc49c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:53.338617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51a73d-735d-49b3-b3dc-059e49cc49c0 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:53.339907 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51a73d-735d-49b3-b3dc-059e49cc49c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:53.340602 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51a73d-735d-49b3-b3dc-059e49cc49c0 None admin] PATH_INFO: `/v3/users/708879e9da6444638f6aa6938bca820c` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:53.358792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149071fc-c266-461b-9959-3166f4c19c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:53.360801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149071fc-c266-461b-9959-3166f4c19c93 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:53.361579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149071fc-c266-461b-9959-3166f4c19c93 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:53.362346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149071fc-c266-461b-9959-3166f4c19c93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:53.367519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149071fc-c266-461b-9959-3166f4c19c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:53.370571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149071fc-c266-461b-9959-3166f4c19c93 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:53.373928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 52/104] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:53.376899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51a73d-735d-49b3-b3dc-059e49cc49c0 None admin] RBAC: Authorizing `identity:get_user(user_id=708879e9da6444638f6aa6938bca820c)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:53.380073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149071fc-c266-461b-9959-3166f4c19c93 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:53.380253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51a73d-735d-49b3-b3dc-059e49cc49c0 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:53.383389 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 53/105] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:53 2022] GET /identity/v3/users/708879e9da6444638f6aa6938bca820c => generated 289 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:53.389573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51a73d-735d-49b3-b3dc-059e49cc49c0 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:53.519257 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149071fc-c266-461b-9959-3166f4c19c93 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:53.557882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af3855-e741-41c3-b6c2-6762f6a12400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:53.558471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3855-e741-41c3-b6c2-6762f6a12400 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:53.558760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3855-e741-41c3-b6c2-6762f6a12400 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:53.559060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3855-e741-41c3-b6c2-6762f6a12400 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:53.559799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af3855-e741-41c3-b6c2-6762f6a12400 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:53.561268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af3855-e741-41c3-b6c2-6762f6a12400 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:53.595666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 53/106] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:16:53 2022] POST /identity/v3/projects => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:16:53.641700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51a73d-735d-49b3-b3dc-059e49cc49c0 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:53.712314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d75e64-4efe-448f-ac86-0e594b6cd134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:53.713406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d75e64-4efe-448f-ac86-0e594b6cd134 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:53.713907 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d75e64-4efe-448f-ac86-0e594b6cd134 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:53.714402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d75e64-4efe-448f-ac86-0e594b6cd134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:53.856329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d75e64-4efe-448f-ac86-0e594b6cd134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:53.859163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d75e64-4efe-448f-ac86-0e594b6cd134 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:53.994664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab31e57-7b4a-4909-bc67-eaba8cf9b281 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:53.994935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab31e57-7b4a-4909-bc67-eaba8cf9b281 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:53.995250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab31e57-7b4a-4909-bc67-eaba8cf9b281 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:53.996936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 54/107] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:54.004354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e0b98-f839-4018-b8f9-94f49587749c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:54.004729 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e0b98-f839-4018-b8f9-94f49587749c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:54.004962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e0b98-f839-4018-b8f9-94f49587749c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:54.044330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5f6e0b98-f839-4018-b8f9-94f49587749c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:54.045565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5f6e0b98-f839-4018-b8f9-94f49587749c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:54.051260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 54/108] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:16:54.062996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d75e64-4efe-448f-ac86-0e594b6cd134 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:54.227838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 55/109] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:54.252831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d75e64-4efe-448f-ac86-0e594b6cd134 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:54.267198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e0b98-f839-4018-b8f9-94f49587749c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:54.318531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbe22c-a56b-47e6-af74-53958f110f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:54.320081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbe22c-a56b-47e6-af74-53958f110f1a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:54.320597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbe22c-a56b-47e6-af74-53958f110f1a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:54.321070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbe22c-a56b-47e6-af74-53958f110f1a None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:54.325275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbe22c-a56b-47e6-af74-53958f110f1a None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:54.329327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbe22c-a56b-47e6-af74-53958f110f1a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:54.331829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 55/110] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:16:54 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:54.338691 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbe22c-a56b-47e6-af74-53958f110f1a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:54.507544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbe22c-a56b-47e6-af74-53958f110f1a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:54.528241 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e0b98-f839-4018-b8f9-94f49587749c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:54.549810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccff37c-7f6b-4bf3-ae64-e8dd407f4a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:54.550497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff37c-7f6b-4bf3-ae64-e8dd407f4a32 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:54.550888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff37c-7f6b-4bf3-ae64-e8dd407f4a32 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:54.551177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccff37c-7f6b-4bf3-ae64-e8dd407f4a32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:54.552044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccff37c-7f6b-4bf3-ae64-e8dd407f4a32 None admin] RBAC: Adding query filter params (role.id=f22059c052f142f7b64fe5c629e314c6, scope.project.id=540bf727f064487c930910ee34bc6da0, user.id=708879e9da6444638f6aa6938bca820c) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:54.552362 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccff37c-7f6b-4bf3-ae64-e8dd407f4a32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:54.553873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccff37c-7f6b-4bf3-ae64-e8dd407f4a32 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:54.568292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 56/111] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:16:54 2022] GET /identity/v3/role_assignments?user.id=708879e9da6444638f6aa6938bca820c&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=f22059c052f142f7b64fe5c629e314c6 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:54.571448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ebf0c-c55c-4645-8580-b76910ee4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:54.572292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ebf0c-c55c-4645-8580-b76910ee4ac7 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:54.572581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ebf0c-c55c-4645-8580-b76910ee4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:54.572864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ebf0c-c55c-4645-8580-b76910ee4ac7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:54.586515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ebf0c-c55c-4645-8580-b76910ee4ac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-ba4ebf0c-c55c-4645-8580-b76910ee4ac7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:54.595172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:54.596193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:16:54.597973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 56/112] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:16:54.603139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccff37c-7f6b-4bf3-ae64-e8dd407f4a32 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:54.652126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee195a-bac5-4baf-a682-cbd24e611808 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:54.652467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee195a-bac5-4baf-a682-cbd24e611808 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:54.652685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee195a-bac5-4baf-a682-cbd24e611808 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:54.654679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 57/113] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:54.660850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2e7c6-48b5-4462-8778-16f5fe4be8f6 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:54.661242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2e7c6-48b5-4462-8778-16f5fe4be8f6 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:54.661527 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2e7c6-48b5-4462-8778-16f5fe4be8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:54.704349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-58c2e7c6-48b5-4462-8778-16f5fe4be8f6 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:54.705662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-58c2e7c6-48b5-4462-8778-16f5fe4be8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:54.734449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccff37c-7f6b-4bf3-ae64-e8dd407f4a32 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:54.782523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840e843-cf90-4d92-924c-8ad5cd348f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:54.783151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e843-cf90-4d92-924c-8ad5cd348f25 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:54.783438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e843-cf90-4d92-924c-8ad5cd348f25 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:54.787062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840e843-cf90-4d92-924c-8ad5cd348f25 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:54.787062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840e843-cf90-4d92-924c-8ad5cd348f25 None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:54.787062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840e843-cf90-4d92-924c-8ad5cd348f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:54.787062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840e843-cf90-4d92-924c-8ad5cd348f25 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:54.795330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 57/114] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:16:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:54.801478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840e843-cf90-4d92-924c-8ad5cd348f25 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:54.881712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 58/115] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:54.895018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c4c22-9084-4f8b-8965-dc7ea66825ab None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:54.895432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c4c22-9084-4f8b-8965-dc7ea66825ab None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:54.895724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c4c22-9084-4f8b-8965-dc7ea66825ab None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:54.897600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 59/116] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:16:54.917122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bae1d3-5fb4-4fac-9e15-756f0a2cfe9c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:54.917443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bae1d3-5fb4-4fac-9e15-756f0a2cfe9c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:54.917682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bae1d3-5fb4-4fac-9e15-756f0a2cfe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:54.933698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840e843-cf90-4d92-924c-8ad5cd348f25 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:54.970351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-28bae1d3-5fb4-4fac-9e15-756f0a2cfe9c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:54.970351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-28bae1d3-5fb4-4fac-9e15-756f0a2cfe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:54.989455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171d536-fc36-4848-ab7b-a10ed69739a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:54.990797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171d536-fc36-4848-ab7b-a10ed69739a4 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:54.993189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171d536-fc36-4848-ab7b-a10ed69739a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:54.993189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171d536-fc36-4848-ab7b-a10ed69739a4 None admin] PATH_INFO: `/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:54.998057 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171d536-fc36-4848-ab7b-a10ed69739a4 None admin] RBAC: Authorizing `identity:get_user(user_id=bf02ab5a7b8c4c06b4049a6a200a1195)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:55.001260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171d536-fc36-4848-ab7b-a10ed69739a4 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:55.004682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 58/117] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:54 2022] GET /identity/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:55.006059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171d536-fc36-4848-ab7b-a10ed69739a4 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:55.121057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 60/118] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:55.122369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bae1d3-5fb4-4fac-9e15-756f0a2cfe9c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:55.227881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171d536-fc36-4848-ab7b-a10ed69739a4 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:55.304932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b584-a74c-4083-a951-fa78b44fd215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:55.305759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b584-a74c-4083-a951-fa78b44fd215 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:55.306441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b584-a74c-4083-a951-fa78b44fd215 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:55.306723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b584-a74c-4083-a951-fa78b44fd215 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:55.315509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bae1d3-5fb4-4fac-9e15-756f0a2cfe9c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:55.336142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78b584-a74c-4083-a951-fa78b44fd215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-4e78b584-a74c-4083-a951-fa78b44fd215 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:55.346690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:55.348356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 59/119] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:55.349643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b584-a74c-4083-a951-fa78b44fd215 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:55.378147 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9e45-1175-4155-8e4a-af205ff552c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:55.378931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9e45-1175-4155-8e4a-af205ff552c1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:55.379246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9e45-1175-4155-8e4a-af205ff552c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:55.379522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9e45-1175-4155-8e4a-af205ff552c1 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:55.384512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb9e45-1175-4155-8e4a-af205ff552c1 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:55.384512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb9e45-1175-4155-8e4a-af205ff552c1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:55.399912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 61/120] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:16:55 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:55.400508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9e45-1175-4155-8e4a-af205ff552c1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:55.517693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78b584-a74c-4083-a951-fa78b44fd215 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:55.555080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3af1-3e30-479b-a587-53b109d65d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:55.555080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3af1-3e30-479b-a587-53b109d65d4b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:55.555369 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3af1-3e30-479b-a587-53b109d65d4b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:55.560435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3af1-3e30-479b-a587-53b109d65d4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:55.585252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e3af1-3e30-479b-a587-53b109d65d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-275e3af1-3e30-479b-a587-53b109d65d4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:55.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:55.596716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 60/121] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:16:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:55.597966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3af1-3e30-479b-a587-53b109d65d4b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:55.613206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9e45-1175-4155-8e4a-af205ff552c1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:55.661119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb3c06-ca83-4a18-8fb0-f1699e1711b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:55.662337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3c06-ca83-4a18-8fb0-f1699e1711b4 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:55.662787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3c06-ca83-4a18-8fb0-f1699e1711b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:55.663408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb3c06-ca83-4a18-8fb0-f1699e1711b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:55.664849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb3c06-ca83-4a18-8fb0-f1699e1711b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:55.665482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb3c06-ca83-4a18-8fb0-f1699e1711b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:55.667394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eb3c06-ca83-4a18-8fb0-f1699e1711b4 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:55.679074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 62/122] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:55.680267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb3c06-ca83-4a18-8fb0-f1699e1711b4 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:55.766485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3af1-3e30-479b-a587-53b109d65d4b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:55.816099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae5568-5a83-454b-a6dd-f23b9c4ba58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:55.817161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae5568-5a83-454b-a6dd-f23b9c4ba58c None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:55.817547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae5568-5a83-454b-a6dd-f23b9c4ba58c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:55.817956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae5568-5a83-454b-a6dd-f23b9c4ba58c None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0/users/bf02ab5a7b8c4c06b4049a6a200a1195/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:55.820434 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae5568-5a83-454b-a6dd-f23b9c4ba58c None admin] RBAC: Authorizing `identity:create_grant(project_id=540bf727f064487c930910ee34bc6da0, user_id=bf02ab5a7b8c4c06b4049a6a200a1195, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:55.821959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae5568-5a83-454b-a6dd-f23b9c4ba58c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:55.824765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb3c06-ca83-4a18-8fb0-f1699e1711b4 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:55.839506 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 61/123] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:16:55 2022] PUT /identity/v3/projects/540bf727f064487c930910ee34bc6da0/users/bf02ab5a7b8c4c06b4049a6a200a1195/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:16:55.841121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf293d7-065a-41f5-872a-8d1c8099a646 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:55.841551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf293d7-065a-41f5-872a-8d1c8099a646 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:55.841937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf293d7-065a-41f5-872a-8d1c8099a646 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:55.844104 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 62/124] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:55.850444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf293d7-065a-41f5-872a-8d1c8099a646 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:55.893391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0ba0a-5e6d-4795-9a07-4239223f8447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:55.894768 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ba0a-5e6d-4795-9a07-4239223f8447 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:55.895506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ba0a-5e6d-4795-9a07-4239223f8447 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:55.896239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0ba0a-5e6d-4795-9a07-4239223f8447 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:55.898101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0ba0a-5e6d-4795-9a07-4239223f8447 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:55.898875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0ba0a-5e6d-4795-9a07-4239223f8447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:55.901688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0ba0a-5e6d-4795-9a07-4239223f8447 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:55.913114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 63/125] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:16:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:55.919555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e621d-4eb7-4a6f-ab02-fa28f00ffa23 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:55.920266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e621d-4eb7-4a6f-ab02-fa28f00ffa23 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:55.920776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e621d-4eb7-4a6f-ab02-fa28f00ffa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:55.944905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-ad0e621d-4eb7-4a6f-ab02-fa28f00ffa23 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:55.946787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ad0e621d-4eb7-4a6f-ab02-fa28f00ffa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:56.002456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf293d7-065a-41f5-872a-8d1c8099a646 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:56.039478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 64/126] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:56.039478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e621d-4eb7-4a6f-ab02-fa28f00ffa23 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:56.083478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d134c-871c-4e07-b1e2-21fbb76ef1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:56.084422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d134c-871c-4e07-b1e2-21fbb76ef1e8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:56.084719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d134c-871c-4e07-b1e2-21fbb76ef1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:56.085024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d134c-871c-4e07-b1e2-21fbb76ef1e8 None admin] PATH_INFO: `/v3/users/7c5460943950426d8cc84743272b5303` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:56.087963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d134c-871c-4e07-b1e2-21fbb76ef1e8 None admin] RBAC: Authorizing `identity:get_user(user_id=7c5460943950426d8cc84743272b5303)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:56.089541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d134c-871c-4e07-b1e2-21fbb76ef1e8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:56.096488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 63/127] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:55 2022] GET /identity/v3/users/7c5460943950426d8cc84743272b5303 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:56.097486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d134c-871c-4e07-b1e2-21fbb76ef1e8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:56.281530 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d134c-871c-4e07-b1e2-21fbb76ef1e8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:56.293610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e621d-4eb7-4a6f-ab02-fa28f00ffa23 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:56.328309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83727a5-6879-433e-857f-505276e9ac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:56.329132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83727a5-6879-433e-857f-505276e9ac1a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:56.329416 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83727a5-6879-433e-857f-505276e9ac1a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:56.329684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83727a5-6879-433e-857f-505276e9ac1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:56.336662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570da4-63ca-4c53-a6fe-5eda356f412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:56.337572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570da4-63ca-4c53-a6fe-5eda356f412d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:56.337871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570da4-63ca-4c53-a6fe-5eda356f412d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:56.338190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570da4-63ca-4c53-a6fe-5eda356f412d None admin] PATH_INFO: `/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:56.339531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc570da4-63ca-4c53-a6fe-5eda356f412d None admin] RBAC: Authorizing `identity:get_user(user_id=bf02ab5a7b8c4c06b4049a6a200a1195)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:56.341031 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc570da4-63ca-4c53-a6fe-5eda356f412d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:56.342453 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83727a5-6879-433e-857f-505276e9ac1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:56.343718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 65/128] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:56 2022] GET /identity/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:56.344577 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570da4-63ca-4c53-a6fe-5eda356f412d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c83727a5-6879-433e-857f-505276e9ac1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:56.351200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:56.352109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:16:56.353326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 64/129] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:56.353983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83727a5-6879-433e-857f-505276e9ac1a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:56.456901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570da4-63ca-4c53-a6fe-5eda356f412d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:56.497367 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286511a-06ef-4746-83c9-bb73dc3398bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:56.498331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286511a-06ef-4746-83c9-bb73dc3398bd None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:56.498621 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286511a-06ef-4746-83c9-bb73dc3398bd None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:56.498985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286511a-06ef-4746-83c9-bb73dc3398bd None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:56.501480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286511a-06ef-4746-83c9-bb73dc3398bd None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:56.503070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e286511a-06ef-4746-83c9-bb73dc3398bd None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:56.504911 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 66/130] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:16:56 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:56.505740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286511a-06ef-4746-83c9-bb73dc3398bd None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:56.567905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83727a5-6879-433e-857f-505276e9ac1a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:56.660587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5df3b-521b-4de7-81da-e44422dbdc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:56.661521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5df3b-521b-4de7-81da-e44422dbdc12 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:56.661814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5df3b-521b-4de7-81da-e44422dbdc12 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:56.662106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5df3b-521b-4de7-81da-e44422dbdc12 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:56.668094 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5df3b-521b-4de7-81da-e44422dbdc12 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:56.669655 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5df3b-521b-4de7-81da-e44422dbdc12 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:56.671843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 65/131] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:16:56 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:56.672518 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5df3b-521b-4de7-81da-e44422dbdc12 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:56.685842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286511a-06ef-4746-83c9-bb73dc3398bd None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:56.748433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2ece2-8cdc-4d4f-853e-7aff8215c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:56.749132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2ece2-8cdc-4d4f-853e-7aff8215c34a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:56.749450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2ece2-8cdc-4d4f-853e-7aff8215c34a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:56.749732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df2ece2-8cdc-4d4f-853e-7aff8215c34a None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:56.750503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2ece2-8cdc-4d4f-853e-7aff8215c34a None admin] RBAC: Adding query filter params (name=member) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:56.750816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2ece2-8cdc-4d4f-853e-7aff8215c34a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:56.754008 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df2ece2-8cdc-4d4f-853e-7aff8215c34a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:56.773273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 67/132] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:16:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:56.774147 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2ece2-8cdc-4d4f-853e-7aff8215c34a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:56.879975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5df3b-521b-4de7-81da-e44422dbdc12 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:56.920461 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c618-7e45-47e5-abc4-787145b9bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:56.922119 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c618-7e45-47e5-abc4-787145b9bfc6 None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:56.922414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c618-7e45-47e5-abc4-787145b9bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:56.922696 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518c618-7e45-47e5-abc4-787145b9bfc6 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0/users/7c5460943950426d8cc84743272b5303/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:56.924872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518c618-7e45-47e5-abc4-787145b9bfc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=540bf727f064487c930910ee34bc6da0, user_id=7c5460943950426d8cc84743272b5303, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:56.926583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518c618-7e45-47e5-abc4-787145b9bfc6 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:56.947409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 66/133] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:16:56 2022] PUT /identity/v3/projects/540bf727f064487c930910ee34bc6da0/users/7c5460943950426d8cc84743272b5303/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:16:56.949220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c618-7e45-47e5-abc4-787145b9bfc6 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:57.028847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df2ece2-8cdc-4d4f-853e-7aff8215c34a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:57.132920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2881ad-203e-49a9-a67c-d5be6bdfd236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:57.133765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2881ad-203e-49a9-a67c-d5be6bdfd236 None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:57.134055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2881ad-203e-49a9-a67c-d5be6bdfd236 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:57.134335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2881ad-203e-49a9-a67c-d5be6bdfd236 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0/users/bf02ab5a7b8c4c06b4049a6a200a1195/roles/8b437ce0fad84637a68c6c151d4e2c5c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:57.136797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2881ad-203e-49a9-a67c-d5be6bdfd236 None admin] RBAC: Authorizing `identity:create_grant(project_id=540bf727f064487c930910ee34bc6da0, user_id=bf02ab5a7b8c4c06b4049a6a200a1195, role_id=8b437ce0fad84637a68c6c151d4e2c5c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:57.138327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2881ad-203e-49a9-a67c-d5be6bdfd236 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:57.170236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 68/134] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:16:56 2022] PUT /identity/v3/projects/540bf727f064487c930910ee34bc6da0/users/bf02ab5a7b8c4c06b4049a6a200a1195/roles/8b437ce0fad84637a68c6c151d4e2c5c => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:16:57.172942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518c618-7e45-47e5-abc4-787145b9bfc6 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:57.234889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6244a-c35c-4ca0-bbc5-37352cbdbb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:57.236280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6244a-c35c-4ca0-bbc5-37352cbdbb82 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:57.236834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6244a-c35c-4ca0-bbc5-37352cbdbb82 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:57.237354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6244a-c35c-4ca0-bbc5-37352cbdbb82 None admin] PATH_INFO: `/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:57.239105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6244a-c35c-4ca0-bbc5-37352cbdbb82 None admin] RBAC: Authorizing `identity:get_user(user_id=bf02ab5a7b8c4c06b4049a6a200a1195)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:57.241045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6244a-c35c-4ca0-bbc5-37352cbdbb82 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:57.243340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 67/135] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:56 2022] GET /identity/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:57.250214 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2881ad-203e-49a9-a67c-d5be6bdfd236 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:57.408448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2881ad-203e-49a9-a67c-d5be6bdfd236 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:57.450296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f7dab-0fd9-4727-a6de-4e6afb556f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:57.451303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f7dab-0fd9-4727-a6de-4e6afb556f57 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:57.451700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f7dab-0fd9-4727-a6de-4e6afb556f57 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:57.451982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f7dab-0fd9-4727-a6de-4e6afb556f57 None admin] PATH_INFO: `/v3/projects/d1245c6793dc4fe5ac304eb7d9b09d36` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:57.453534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f7dab-0fd9-4727-a6de-4e6afb556f57 None admin] RBAC: Authorizing `identity:get_project(project_id=d1245c6793dc4fe5ac304eb7d9b09d36)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:57.455162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f7dab-0fd9-4727-a6de-4e6afb556f57 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:57.457143 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 69/136] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:16:57 2022] GET /identity/v3/projects/d1245c6793dc4fe5ac304eb7d9b09d36 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:57.463709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6244a-c35c-4ca0-bbc5-37352cbdbb82 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:57.556287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620c18-2b29-4c58-9e37-6aedd44c3959 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:57.556629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620c18-2b29-4c58-9e37-6aedd44c3959 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:57.556853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9620c18-2b29-4c58-9e37-6aedd44c3959 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:57.558459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 70/137] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:16:57.572764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fb27c-0d6a-4dc5-8878-0317ffe798b2 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:57.573058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fb27c-0d6a-4dc5-8878-0317ffe798b2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:57.573322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fb27c-0d6a-4dc5-8878-0317ffe798b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:57.604228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-598fb27c-0d6a-4dc5-8878-0317ffe798b2 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:57.605465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-598fb27c-0d6a-4dc5-8878-0317ffe798b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:57.622077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6244a-c35c-4ca0-bbc5-37352cbdbb82 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:57.712791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b113a-5601-429d-a38b-2c192d03c47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:57.713653 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b113a-5601-429d-a38b-2c192d03c47a None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:57.713935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b113a-5601-429d-a38b-2c192d03c47a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:57.714209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b113a-5601-429d-a38b-2c192d03c47a None admin] PATH_INFO: `/v3/projects/d1245c6793dc4fe5ac304eb7d9b09d36/users/bf02ab5a7b8c4c06b4049a6a200a1195/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:57.716345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b113a-5601-429d-a38b-2c192d03c47a None admin] RBAC: Authorizing `identity:create_grant(project_id=d1245c6793dc4fe5ac304eb7d9b09d36, user_id=bf02ab5a7b8c4c06b4049a6a200a1195, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:57.717986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b113a-5601-429d-a38b-2c192d03c47a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:57.736399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 68/138] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:16:57 2022] PUT /identity/v3/projects/d1245c6793dc4fe5ac304eb7d9b09d36/users/bf02ab5a7b8c4c06b4049a6a200a1195/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:16:57.737971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 71/139] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:57.740493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34207905-dfd8-4925-893c-19ab00795de8 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:57.740777 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34207905-dfd8-4925-893c-19ab00795de8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:57.741123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34207905-dfd8-4925-893c-19ab00795de8 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:57.742799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 69/140] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:57.755591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788feb4-b466-436d-908f-8871325ce310 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:57.755920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788feb4-b466-436d-908f-8871325ce310 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:57.756156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788feb4-b466-436d-908f-8871325ce310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:57.783910 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b788feb4-b466-436d-908f-8871325ce310 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:57.785269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b788feb4-b466-436d-908f-8871325ce310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:57.822610 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34207905-dfd8-4925-893c-19ab00795de8 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:57.878817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 72/141] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:16:57.907063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788feb4-b466-436d-908f-8871325ce310 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:58.020688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788feb4-b466-436d-908f-8871325ce310 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:58.061291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045fe10-6a63-4f28-a35a-dd006384d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:58.062712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045fe10-6a63-4f28-a35a-dd006384d496 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:58.063011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045fe10-6a63-4f28-a35a-dd006384d496 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:58.063317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045fe10-6a63-4f28-a35a-dd006384d496 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:58.069326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045fe10-6a63-4f28-a35a-dd006384d496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:58.070831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045fe10-6a63-4f28-a35a-dd006384d496 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:58.072577 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 73/142] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:58.085680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045fe10-6a63-4f28-a35a-dd006384d496 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:58.111150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34207905-dfd8-4925-893c-19ab00795de8 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:58.159412 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed35a52-b6c6-45e2-91f1-1a213d795675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:58.160289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed35a52-b6c6-45e2-91f1-1a213d795675 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:58.164594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed35a52-b6c6-45e2-91f1-1a213d795675 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:58.164902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed35a52-b6c6-45e2-91f1-1a213d795675 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:58.183428 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed35a52-b6c6-45e2-91f1-1a213d795675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-5ed35a52-b6c6-45e2-91f1-1a213d795675 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:16:58.195391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:16:58.196322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:16:58.197096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 70/143] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:16:58.203046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed35a52-b6c6-45e2-91f1-1a213d795675 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:58.313449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed35a52-b6c6-45e2-91f1-1a213d795675 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:58.349995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3dec0-95d9-4f84-bca2-9375c95cfc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:58.350721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3dec0-95d9-4f84-bca2-9375c95cfc40 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:58.351009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3dec0-95d9-4f84-bca2-9375c95cfc40 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:58.351445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3dec0-95d9-4f84-bca2-9375c95cfc40 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:58.352212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3dec0-95d9-4f84-bca2-9375c95cfc40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:16:58.352520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3dec0-95d9-4f84-bca2-9375c95cfc40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:58.353166 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045fe10-6a63-4f28-a35a-dd006384d496 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:58.353934 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3dec0-95d9-4f84-bca2-9375c95cfc40 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:58.363596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 71/144] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:16:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:58.369545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3dec0-95d9-4f84-bca2-9375c95cfc40 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:58.444325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f982bc-b8c4-4b7a-ba63-d63fe5fd45e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:58.445021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f982bc-b8c4-4b7a-ba63-d63fe5fd45e6 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:58.445309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f982bc-b8c4-4b7a-ba63-d63fe5fd45e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:58.445589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f982bc-b8c4-4b7a-ba63-d63fe5fd45e6 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:58.446317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f982bc-b8c4-4b7a-ba63-d63fe5fd45e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:58.447790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f982bc-b8c4-4b7a-ba63-d63fe5fd45e6 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:58.478241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3dec0-95d9-4f84-bca2-9375c95cfc40 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:58.509631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 74/145] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:16:58 2022] POST /identity/v3/users => generated 283 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:16:58.519493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7306606-f2d1-4228-a0d5-e9a6b112c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:58.520482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306606-f2d1-4228-a0d5-e9a6b112c20a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:58.520809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306606-f2d1-4228-a0d5-e9a6b112c20a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:58.521086 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7306606-f2d1-4228-a0d5-e9a6b112c20a None admin] PATH_INFO: `/v3/users/708879e9da6444638f6aa6938bca820c` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:58.522747 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7306606-f2d1-4228-a0d5-e9a6b112c20a None admin] RBAC: Authorizing `identity:get_user(user_id=708879e9da6444638f6aa6938bca820c)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:58.524308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7306606-f2d1-4228-a0d5-e9a6b112c20a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:58.526350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 72/146] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:16:58 2022] GET /identity/v3/users/708879e9da6444638f6aa6938bca820c => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:16:58.544042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f982bc-b8c4-4b7a-ba63-d63fe5fd45e6 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:58.682908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f982bc-b8c4-4b7a-ba63-d63fe5fd45e6 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:58.720500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5216a22-c1c1-45ce-b9a4-e3f4b888ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:58.721736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216a22-c1c1-45ce-b9a4-e3f4b888ba5e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:58.722322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216a22-c1c1-45ce-b9a4-e3f4b888ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:58.722805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5216a22-c1c1-45ce-b9a4-e3f4b888ba5e None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:58.724342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5216a22-c1c1-45ce-b9a4-e3f4b888ba5e None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:58.726387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5216a22-c1c1-45ce-b9a4-e3f4b888ba5e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:58.728804 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 75/147] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:16:58 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:16:58.736110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7306606-f2d1-4228-a0d5-e9a6b112c20a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:58.900600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7306606-f2d1-4228-a0d5-e9a6b112c20a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:16:58.953534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a96ee8-74c9-4d9b-9855-2acafcda5784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:16:58.954367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a96ee8-74c9-4d9b-9855-2acafcda5784 None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:58.954651 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a96ee8-74c9-4d9b-9855-2acafcda5784 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:58.954933 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a96ee8-74c9-4d9b-9855-2acafcda5784 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0/users/708879e9da6444638f6aa6938bca820c/roles/f22059c052f142f7b64fe5c629e314c6` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:58.965107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a96ee8-74c9-4d9b-9855-2acafcda5784 None admin] RBAC: Authorizing `identity:create_grant(project_id=540bf727f064487c930910ee34bc6da0, user_id=708879e9da6444638f6aa6938bca820c, role_id=f22059c052f142f7b64fe5c629e314c6)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:16:58.966616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a96ee8-74c9-4d9b-9855-2acafcda5784 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:16:58.987192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 73/148] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:16:58 2022] PUT /identity/v3/projects/540bf727f064487c930910ee34bc6da0/users/708879e9da6444638f6aa6938bca820c/roles/f22059c052f142f7b64fe5c629e314c6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:16:59.643018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a6659-d8b5-4aa2-a327-5472ba19bf8f None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:59.643549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a6659-d8b5-4aa2-a327-5472ba19bf8f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:59.644009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a6659-d8b5-4aa2-a327-5472ba19bf8f None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:59.646916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 76/149] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:16:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:16:59.653905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf434e4c-58d1-40d6-ad6c-4825576106a5 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:16:59.654471 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf434e4c-58d1-40d6-ad6c-4825576106a5 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:16:59.654941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf434e4c-58d1-40d6-ad6c-4825576106a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:16:59.687929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-bf434e4c-58d1-40d6-ad6c-4825576106a5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:16:59.689893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-bf434e4c-58d1-40d6-ad6c-4825576106a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:16:59.830581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 74/150] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:16:59.858177 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a6659-d8b5-4aa2-a327-5472ba19bf8f None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:16:59.987417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a6659-d8b5-4aa2-a327-5472ba19bf8f None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:00.028543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42905b2e-3769-4e49-b3f9-2ac26882a8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:00.029347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42905b2e-3769-4e49-b3f9-2ac26882a8cd None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:00.029630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42905b2e-3769-4e49-b3f9-2ac26882a8cd None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:00.029901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42905b2e-3769-4e49-b3f9-2ac26882a8cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:00.041349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42905b2e-3769-4e49-b3f9-2ac26882a8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-42905b2e-3769-4e49-b3f9-2ac26882a8cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:00.049907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:00.050802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:00.051589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 77/151] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:16:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:00.057438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf434e4c-58d1-40d6-ad6c-4825576106a5 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:00.166166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf434e4c-58d1-40d6-ad6c-4825576106a5 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:00.202838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860f51-776d-47c5-b65e-68919423b64f None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:00.203161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860f51-776d-47c5-b65e-68919423b64f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:00.203433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9860f51-776d-47c5-b65e-68919423b64f None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:00.204814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 78/152] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:00.206806 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1681d-ba64-401a-9ccb-7ee32a21208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:00.207525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1681d-ba64-401a-9ccb-7ee32a21208f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:00.207812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1681d-ba64-401a-9ccb-7ee32a21208f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:00.208101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1681d-ba64-401a-9ccb-7ee32a21208f None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:00.208870 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1681d-ba64-401a-9ccb-7ee32a21208f None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:00.209176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1681d-ba64-401a-9ccb-7ee32a21208f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:00.210592 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1681d-ba64-401a-9ccb-7ee32a21208f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:00.216805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a163f9-8c45-46c9-9913-00eb7306f15d None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:00.217079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a163f9-8c45-46c9-9913-00eb7306f15d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:00.217428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a163f9-8c45-46c9-9913-00eb7306f15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:00.221033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 75/153] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:00.226649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1681d-ba64-401a-9ccb-7ee32a21208f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:00.256146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-89a163f9-8c45-46c9-9913-00eb7306f15d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:00.257397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-89a163f9-8c45-46c9-9913-00eb7306f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:00.342018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1681d-ba64-401a-9ccb-7ee32a21208f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:00.380356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cdc2c-0cc3-4f42-be58-f4506b53eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:00.381217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cdc2c-0cc3-4f42-be58-f4506b53eec2 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:00.381498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cdc2c-0cc3-4f42-be58-f4506b53eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:00.381773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cdc2c-0cc3-4f42-be58-f4506b53eec2 None admin] PATH_INFO: `/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:00.383078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cdc2c-0cc3-4f42-be58-f4506b53eec2 None admin] RBAC: Authorizing `identity:get_user(user_id=bf02ab5a7b8c4c06b4049a6a200a1195)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:00.384914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cdc2c-0cc3-4f42-be58-f4506b53eec2 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:00.386977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 76/154] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:00 2022] GET /identity/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:00.395856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cdc2c-0cc3-4f42-be58-f4506b53eec2 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:00.409275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 79/155] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:00.455344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a163f9-8c45-46c9-9913-00eb7306f15d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:00.509239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cdc2c-0cc3-4f42-be58-f4506b53eec2 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:00.549063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14165f-eaec-46dc-95a4-fb81b777a875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:00.550138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14165f-eaec-46dc-95a4-fb81b777a875 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:00.550422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14165f-eaec-46dc-95a4-fb81b777a875 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:00.550708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14165f-eaec-46dc-95a4-fb81b777a875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:00.630154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14165f-eaec-46dc-95a4-fb81b777a875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:00.631777 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14165f-eaec-46dc-95a4-fb81b777a875 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:00.669848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a163f9-8c45-46c9-9913-00eb7306f15d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:00.724391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea8aa3-d2ba-408a-9eb4-a1574f588934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:00.725235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea8aa3-d2ba-408a-9eb4-a1574f588934 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:00.725523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea8aa3-d2ba-408a-9eb4-a1574f588934 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:00.725814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea8aa3-d2ba-408a-9eb4-a1574f588934 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:00.739320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 77/156] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:00.744899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14165f-eaec-46dc-95a4-fb81b777a875 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:00.755332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea8aa3-d2ba-408a-9eb4-a1574f588934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-a6ea8aa3-d2ba-408a-9eb4-a1574f588934 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:00.760884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:00.763227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:00.766511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 80/157] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:17:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:00.772575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea8aa3-d2ba-408a-9eb4-a1574f588934 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:00.974973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea8aa3-d2ba-408a-9eb4-a1574f588934 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:01.001310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14165f-eaec-46dc-95a4-fb81b777a875 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:01.026300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7679d4-a6d6-432a-ab7d-42673ef5a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:01.026903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7679d4-a6d6-432a-ab7d-42673ef5a799 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:01.027272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7679d4-a6d6-432a-ab7d-42673ef5a799 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:01.027558 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7679d4-a6d6-432a-ab7d-42673ef5a799 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:01.028325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7679d4-a6d6-432a-ab7d-42673ef5a799 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:01.028639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7679d4-a6d6-432a-ab7d-42673ef5a799 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:01.030054 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7679d4-a6d6-432a-ab7d-42673ef5a799 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:01.043482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 81/158] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:01.049123 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7679d4-a6d6-432a-ab7d-42673ef5a799 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:01.080851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9aca69-85eb-46d5-b1d4-4178b277e631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:01.081742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aca69-85eb-46d5-b1d4-4178b277e631 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:01.082030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aca69-85eb-46d5-b1d4-4178b277e631 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:01.082311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9aca69-85eb-46d5-b1d4-4178b277e631 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:01.088195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9aca69-85eb-46d5-b1d4-4178b277e631 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:01.090894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9aca69-85eb-46d5-b1d4-4178b277e631 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:01.094796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 78/159] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:00 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:01.103728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9aca69-85eb-46d5-b1d4-4178b277e631 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:01.191832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7679d4-a6d6-432a-ab7d-42673ef5a799 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:01.247814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4427bf0-76f4-43ff-84a4-6013f4c22a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:01.248747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4427bf0-76f4-43ff-84a4-6013f4c22a8e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:01.249108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4427bf0-76f4-43ff-84a4-6013f4c22a8e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:01.249929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4427bf0-76f4-43ff-84a4-6013f4c22a8e None admin] PATH_INFO: `/v3/users/7c5460943950426d8cc84743272b5303` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:01.251455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4427bf0-76f4-43ff-84a4-6013f4c22a8e None admin] RBAC: Authorizing `identity:get_user(user_id=7c5460943950426d8cc84743272b5303)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:01.253788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4427bf0-76f4-43ff-84a4-6013f4c22a8e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:01.256161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 82/160] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:01 2022] GET /identity/v3/users/7c5460943950426d8cc84743272b5303 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:01.262888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4427bf0-76f4-43ff-84a4-6013f4c22a8e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:01.317999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9aca69-85eb-46d5-b1d4-4178b277e631 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:01.483379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7278-7a2b-491f-a030-2ea41c795bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:01.485019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7278-7a2b-491f-a030-2ea41c795bf4 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:01.485496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7278-7a2b-491f-a030-2ea41c795bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:01.485961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db7278-7a2b-491f-a030-2ea41c795bf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:01.487540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7278-7a2b-491f-a030-2ea41c795bf4 None admin] RBAC: Adding query filter params (role.id=2d441060f04441848c895dc5b9affb06, scope.project.id=540bf727f064487c930910ee34bc6da0, user.id=bf02ab5a7b8c4c06b4049a6a200a1195) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:01.488069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7278-7a2b-491f-a030-2ea41c795bf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:01.490848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db7278-7a2b-491f-a030-2ea41c795bf4 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:01.504951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 79/161] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:01 2022] GET /identity/v3/role_assignments?user.id=bf02ab5a7b8c4c06b4049a6a200a1195&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=2d441060f04441848c895dc5b9affb06 => generated 608 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:01.551240 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4427bf0-76f4-43ff-84a4-6013f4c22a8e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:01.594056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932ccfe-f3cd-4d85-8f20-349290dfd67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:01.594658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932ccfe-f3cd-4d85-8f20-349290dfd67b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:01.594943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932ccfe-f3cd-4d85-8f20-349290dfd67b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:01.595248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932ccfe-f3cd-4d85-8f20-349290dfd67b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:01.693296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932ccfe-f3cd-4d85-8f20-349290dfd67b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:01.694831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932ccfe-f3cd-4d85-8f20-349290dfd67b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:01.855222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 83/162] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:01.860698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7278-7a2b-491f-a030-2ea41c795bf4 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:01.863329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b7f00-6934-4a82-85cc-948718772eec None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:01.863625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b7f00-6934-4a82-85cc-948718772eec None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:01.863903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b7f00-6934-4a82-85cc-948718772eec None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:01.865282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 84/163] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:01.875006 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503a9c-c7cb-455a-b15e-c14ebbe95648 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:01.875336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503a9c-c7cb-455a-b15e-c14ebbe95648 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:01.875590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503a9c-c7cb-455a-b15e-c14ebbe95648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:01.908289 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b0503a9c-c7cb-455a-b15e-c14ebbe95648 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:01.909513 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b0503a9c-c7cb-455a-b15e-c14ebbe95648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:02.082593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 85/164] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:02.094262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db7278-7a2b-491f-a030-2ea41c795bf4 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:02.118720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0503a9c-c7cb-455a-b15e-c14ebbe95648 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:02.149219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad15feb-672c-4f66-8ec6-e11a51891132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:02.150091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15feb-672c-4f66-8ec6-e11a51891132 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:02.150373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15feb-672c-4f66-8ec6-e11a51891132 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:02.150649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad15feb-672c-4f66-8ec6-e11a51891132 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:02.151991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad15feb-672c-4f66-8ec6-e11a51891132 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:02.153451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad15feb-672c-4f66-8ec6-e11a51891132 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:02.155168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 80/165] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:01 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:02.163120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad15feb-672c-4f66-8ec6-e11a51891132 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:02.319010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0503a9c-c7cb-455a-b15e-c14ebbe95648 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:02.342234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad15feb-672c-4f66-8ec6-e11a51891132 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:02.393932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb634106-c2c3-4e48-8e70-fc7aa88f8e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:02.394673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb634106-c2c3-4e48-8e70-fc7aa88f8e18 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:02.394960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb634106-c2c3-4e48-8e70-fc7aa88f8e18 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:02.395277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb634106-c2c3-4e48-8e70-fc7aa88f8e18 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:02.411536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17bb2b-1116-4d5e-9b9c-b904bfdfa85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:02.412212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17bb2b-1116-4d5e-9b9c-b904bfdfa85b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:02.412719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17bb2b-1116-4d5e-9b9c-b904bfdfa85b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:02.413006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17bb2b-1116-4d5e-9b9c-b904bfdfa85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:02.414306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17bb2b-1116-4d5e-9b9c-b904bfdfa85b None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=540bf727f064487c930910ee34bc6da0, user.id=7c5460943950426d8cc84743272b5303) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:02.414633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17bb2b-1116-4d5e-9b9c-b904bfdfa85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:02.416000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb634106-c2c3-4e48-8e70-fc7aa88f8e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:02.416333 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17bb2b-1116-4d5e-9b9c-b904bfdfa85b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:02.423000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 81/166] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:02 2022] GET /identity/v3/role_assignments?user.id=7c5460943950426d8cc84743272b5303&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-fb634106-c2c3-4e48-8e70-fc7aa88f8e18 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:02.424433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:02.425287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:02.426173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 86/167] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:02.432519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17bb2b-1116-4d5e-9b9c-b904bfdfa85b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:02.626248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17bb2b-1116-4d5e-9b9c-b904bfdfa85b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:02.672860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98280e54-c804-4b22-92bb-d85ff5a2e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:02.673465 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98280e54-c804-4b22-92bb-d85ff5a2e347 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:02.673817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98280e54-c804-4b22-92bb-d85ff5a2e347 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:02.674096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98280e54-c804-4b22-92bb-d85ff5a2e347 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:02.674921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98280e54-c804-4b22-92bb-d85ff5a2e347 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:02.675255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98280e54-c804-4b22-92bb-d85ff5a2e347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:02.676671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98280e54-c804-4b22-92bb-d85ff5a2e347 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:02.692522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59841b33-0049-4751-a305-462c2cb8859d None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:02.692825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59841b33-0049-4751-a305-462c2cb8859d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:02.693097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59841b33-0049-4751-a305-462c2cb8859d None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:02.694799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 87/168] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:02.699291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 82/169] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:02.700473 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a740a9-a665-482b-9a44-187670541c8f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:02.701061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a740a9-a665-482b-9a44-187670541c8f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:02.701549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a740a9-a665-482b-9a44-187670541c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:02.707075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98280e54-c804-4b22-92bb-d85ff5a2e347 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:02.741852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-90a740a9-a665-482b-9a44-187670541c8f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:02.744126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-90a740a9-a665-482b-9a44-187670541c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:02.842770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98280e54-c804-4b22-92bb-d85ff5a2e347 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:02.922832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027fd9f-a1a3-4d3f-b2d8-78b790090b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:02.923955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027fd9f-a1a3-4d3f-b2d8-78b790090b9e None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:02.924110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027fd9f-a1a3-4d3f-b2d8-78b790090b9e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:02.924466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027fd9f-a1a3-4d3f-b2d8-78b790090b9e None admin] PATH_INFO: `/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:02.925704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 88/170] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:02.926394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027fd9f-a1a3-4d3f-b2d8-78b790090b9e None admin] RBAC: Authorizing `identity:get_user(user_id=bf02ab5a7b8c4c06b4049a6a200a1195)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:02.928004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027fd9f-a1a3-4d3f-b2d8-78b790090b9e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:02.929669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 83/171] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:02 2022] GET /identity/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:02.935281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a740a9-a665-482b-9a44-187670541c8f None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:02.989794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027fd9f-a1a3-4d3f-b2d8-78b790090b9e None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:03.081033 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a740a9-a665-482b-9a44-187670541c8f None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:03.122679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65f585-7160-455b-a142-1571fad3e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:03.123383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65f585-7160-455b-a142-1571fad3e92c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:03.123673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65f585-7160-455b-a142-1571fad3e92c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:03.123950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65f585-7160-455b-a142-1571fad3e92c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:03.135180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027fd9f-a1a3-4d3f-b2d8-78b790090b9e None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:03.176122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6dc85-6dac-479c-b30e-1f4e6ec1b22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:03.176833 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6dc85-6dac-479c-b30e-1f4e6ec1b22a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:03.177113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6dc85-6dac-479c-b30e-1f4e6ec1b22a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:03.177396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6dc85-6dac-479c-b30e-1f4e6ec1b22a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:03.189112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6dc85-6dac-479c-b30e-1f4e6ec1b22a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-fcf6dc85-6dac-479c-b30e-1f4e6ec1b22a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:03.196956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:03.198670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:03.200804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 84/172] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:03.212996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65f585-7160-455b-a142-1571fad3e92c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:03.213337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6dc85-6dac-479c-b30e-1f4e6ec1b22a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:03.214520 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65f585-7160-455b-a142-1571fad3e92c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:03.319397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 89/173] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:03.324807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65f585-7160-455b-a142-1571fad3e92c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:03.336850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6dc85-6dac-479c-b30e-1f4e6ec1b22a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:03.372927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a0ea3-95d8-40aa-9409-8eb9f45315c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:03.373622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a0ea3-95d8-40aa-9409-8eb9f45315c2 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:03.373911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a0ea3-95d8-40aa-9409-8eb9f45315c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:03.374225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a0ea3-95d8-40aa-9409-8eb9f45315c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:03.375006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a0ea3-95d8-40aa-9409-8eb9f45315c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:03.375348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a0ea3-95d8-40aa-9409-8eb9f45315c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:03.377141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a0ea3-95d8-40aa-9409-8eb9f45315c2 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:03.385970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 85/174] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:03.391875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a0ea3-95d8-40aa-9409-8eb9f45315c2 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:03.529000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a0ea3-95d8-40aa-9409-8eb9f45315c2 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:03.542383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65f585-7160-455b-a142-1571fad3e92c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:03.564115 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a5d1f-9e6b-4237-aee4-d69b53253e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:03.565041 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5d1f-9e6b-4237-aee4-d69b53253e60 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:03.565289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5d1f-9e6b-4237-aee4-d69b53253e60 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:03.565557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a5d1f-9e6b-4237-aee4-d69b53253e60 None admin] PATH_INFO: `/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:03.566807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a5d1f-9e6b-4237-aee4-d69b53253e60 None admin] RBAC: Authorizing `identity:get_user(user_id=bf02ab5a7b8c4c06b4049a6a200a1195)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:03.568321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a5d1f-9e6b-4237-aee4-d69b53253e60 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:03.570031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 86/175] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:03 2022] GET /identity/v3/users/bf02ab5a7b8c4c06b4049a6a200a1195 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:03.576301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a5d1f-9e6b-4237-aee4-d69b53253e60 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:03.609420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb49fff-c3bb-4e95-bdf1-8062be58d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:03.610800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb49fff-c3bb-4e95-bdf1-8062be58d898 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:03.611284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb49fff-c3bb-4e95-bdf1-8062be58d898 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:03.611712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb49fff-c3bb-4e95-bdf1-8062be58d898 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:03.613743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb49fff-c3bb-4e95-bdf1-8062be58d898 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:03.616304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb49fff-c3bb-4e95-bdf1-8062be58d898 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:03.623211 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 90/176] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:03 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:03.628539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb49fff-c3bb-4e95-bdf1-8062be58d898 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:03.683659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a5d1f-9e6b-4237-aee4-d69b53253e60 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:03.720150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c09a3-0e74-44cb-84f5-532add4f238f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:03.720823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c09a3-0e74-44cb-84f5-532add4f238f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:03.721113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c09a3-0e74-44cb-84f5-532add4f238f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:03.721395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c09a3-0e74-44cb-84f5-532add4f238f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:03.796998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb49fff-c3bb-4e95-bdf1-8062be58d898 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:03.805096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c09a3-0e74-44cb-84f5-532add4f238f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:03.806636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c09a3-0e74-44cb-84f5-532add4f238f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:03.855254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1640c8-71fe-4794-861c-ee76d8b9cb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:03.856274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1640c8-71fe-4794-861c-ee76d8b9cb6a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:03.856739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1640c8-71fe-4794-861c-ee76d8b9cb6a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:03.857160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1640c8-71fe-4794-861c-ee76d8b9cb6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:03.859279 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1640c8-71fe-4794-861c-ee76d8b9cb6a None admin] RBAC: Adding query filter params (role.id=8b437ce0fad84637a68c6c151d4e2c5c, scope.project.id=540bf727f064487c930910ee34bc6da0, user.id=bf02ab5a7b8c4c06b4049a6a200a1195) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:03.859769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1640c8-71fe-4794-861c-ee76d8b9cb6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:03.862198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1640c8-71fe-4794-861c-ee76d8b9cb6a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:03.877749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 91/177] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:03 2022] GET /identity/v3/role_assignments?user.id=bf02ab5a7b8c4c06b4049a6a200a1195&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=8b437ce0fad84637a68c6c151d4e2c5c => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:03.880071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388ace7-6ff4-4155-86a5-5f24ee8826ab None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:03.880537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388ace7-6ff4-4155-86a5-5f24ee8826ab None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:03.880986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388ace7-6ff4-4155-86a5-5f24ee8826ab None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:03.883339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 92/178] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:03.890641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103dea-dcea-4b54-b909-5ae44a6849f2 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:03.891134 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103dea-dcea-4b54-b909-5ae44a6849f2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:03.891598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75103dea-dcea-4b54-b909-5ae44a6849f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:03.917986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 87/179] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:17:03.924970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c09a3-0e74-44cb-84f5-532add4f238f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:03.928634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-75103dea-dcea-4b54-b909-5ae44a6849f2 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:03.930276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-75103dea-dcea-4b54-b909-5ae44a6849f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:04.012042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 93/180] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:04.036989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17b196-be31-44e5-a578-75eb004134a9 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.037371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17b196-be31-44e5-a578-75eb004134a9 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.037591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17b196-be31-44e5-a578-75eb004134a9 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.039560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 94/181] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:04.040352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17b196-be31-44e5-a578-75eb004134a9 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:04.161544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c09a3-0e74-44cb-84f5-532add4f238f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:04.224215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b9960-b21d-4e42-91bb-a45bfde68942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:04.225093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17b196-be31-44e5-a578-75eb004134a9 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:04.225269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b9960-b21d-4e42-91bb-a45bfde68942 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.225398 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b9960-b21d-4e42-91bb-a45bfde68942 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.225654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b9960-b21d-4e42-91bb-a45bfde68942 None admin] PATH_INFO: `/v3/projects/d1245c6793dc4fe5ac304eb7d9b09d36` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.227111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b9960-b21d-4e42-91bb-a45bfde68942 None admin] RBAC: Authorizing `identity:get_project(project_id=d1245c6793dc4fe5ac304eb7d9b09d36)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:04.229571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b9960-b21d-4e42-91bb-a45bfde68942 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:04.231721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 88/182] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:03 2022] GET /identity/v3/projects/d1245c6793dc4fe5ac304eb7d9b09d36 => generated 312 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:04.232970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffce63-5299-4c73-9c7b-9d9ff2e94827 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.233263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffce63-5299-4c73-9c7b-9d9ff2e94827 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.233638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffce63-5299-4c73-9c7b-9d9ff2e94827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.253914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b1ffce63-5299-4c73-9c7b-9d9ff2e94827 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:04.255158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b1ffce63-5299-4c73-9c7b-9d9ff2e94827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:04.273198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ed3cd-c49b-4d40-9cf6-845ae6e5acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:04.274017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ed3cd-c49b-4d40-9cf6-845ae6e5acc8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.274300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ed3cd-c49b-4d40-9cf6-845ae6e5acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.274568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ed3cd-c49b-4d40-9cf6-845ae6e5acc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.287562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ed3cd-c49b-4d40-9cf6-845ae6e5acc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-408ed3cd-c49b-4d40-9cf6-845ae6e5acc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:04.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:04.298666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:04.301591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 95/183] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:17:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:04.303988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ed3cd-c49b-4d40-9cf6-845ae6e5acc8 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:04.338482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 89/184] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:04.339139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffce63-5299-4c73-9c7b-9d9ff2e94827 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:04.412903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ed3cd-c49b-4d40-9cf6-845ae6e5acc8 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:04.445283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffce63-5299-4c73-9c7b-9d9ff2e94827 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:04.449830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4b23-a795-4dda-9804-41783663fb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:04.450481 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4b23-a795-4dda-9804-41783663fb71 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.450766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4b23-a795-4dda-9804-41783663fb71 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.451067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4b23-a795-4dda-9804-41783663fb71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.451976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd4b23-a795-4dda-9804-41783663fb71 None admin] RBAC: Adding query filter params (role.id=2d441060f04441848c895dc5b9affb06, scope.project.id=d1245c6793dc4fe5ac304eb7d9b09d36, user.id=bf02ab5a7b8c4c06b4049a6a200a1195) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:04.452896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd4b23-a795-4dda-9804-41783663fb71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:04.454380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd4b23-a795-4dda-9804-41783663fb71 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:04.460880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 96/185] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:04 2022] GET /identity/v3/role_assignments?user.id=bf02ab5a7b8c4c06b4049a6a200a1195&scope.project.id=d1245c6793dc4fe5ac304eb7d9b09d36&role.id=2d441060f04441848c895dc5b9affb06 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:04.461846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4b23-a795-4dda-9804-41783663fb71 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:04.487011 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2434692-4092-4a42-8336-39e82a592fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:04.487746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2434692-4092-4a42-8336-39e82a592fd9 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.488034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2434692-4092-4a42-8336-39e82a592fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.488317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2434692-4092-4a42-8336-39e82a592fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.489088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2434692-4092-4a42-8336-39e82a592fd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:04.489400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2434692-4092-4a42-8336-39e82a592fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:04.490822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2434692-4092-4a42-8336-39e82a592fd9 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:04.500873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 90/186] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:04.506555 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2434692-4092-4a42-8336-39e82a592fd9 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:04.607798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd4b23-a795-4dda-9804-41783663fb71 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:04.644569 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7639e6-7ce8-4fd2-ae05-09e777b1a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:04.645451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7639e6-7ce8-4fd2-ae05-09e777b1a911 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.645741 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7639e6-7ce8-4fd2-ae05-09e777b1a911 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.646022 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7639e6-7ce8-4fd2-ae05-09e777b1a911 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.648191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2434692-4092-4a42-8336-39e82a592fd9 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:04.658749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7639e6-7ce8-4fd2-ae05-09e777b1a911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-8d7639e6-7ce8-4fd2-ae05-09e777b1a911 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:04.667093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:04.669228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:04.671235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 97/187] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:04.679075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7639e6-7ce8-4fd2-ae05-09e777b1a911 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:04.685296 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7256c-9d2f-442e-b2be-c94a770428ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:04.686303 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7256c-9d2f-442e-b2be-c94a770428ea None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.686622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7256c-9d2f-442e-b2be-c94a770428ea None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.686912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7256c-9d2f-442e-b2be-c94a770428ea None admin] PATH_INFO: `/v3/users/1d77c6ecd64d45148cd98e037b72e133` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.702830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7256c-9d2f-442e-b2be-c94a770428ea None admin] RBAC: Authorizing `identity:get_user(user_id=1d77c6ecd64d45148cd98e037b72e133)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:04.704432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7256c-9d2f-442e-b2be-c94a770428ea None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:04.706588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 91/188] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:04 2022] GET /identity/v3/users/1d77c6ecd64d45148cd98e037b72e133 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:04.712176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7256c-9d2f-442e-b2be-c94a770428ea None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:04.796764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7639e6-7ce8-4fd2-ae05-09e777b1a911 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:04.828504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7256c-9d2f-442e-b2be-c94a770428ea None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:04.836883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d351429-5440-4fd5-b2e6-11ab23394f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:04.838276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351429-5440-4fd5-b2e6-11ab23394f9b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.838764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351429-5440-4fd5-b2e6-11ab23394f9b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.839278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d351429-5440-4fd5-b2e6-11ab23394f9b None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.840247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d351429-5440-4fd5-b2e6-11ab23394f9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:04.840756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d351429-5440-4fd5-b2e6-11ab23394f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:04.842434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d351429-5440-4fd5-b2e6-11ab23394f9b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:04.852036 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 98/189] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:04.853710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fcedc-4eb2-49e9-ab92-4ea835f5dc0f None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.854233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fcedc-4eb2-49e9-ab92-4ea835f5dc0f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.854713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fcedc-4eb2-49e9-ab92-4ea835f5dc0f None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.856304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 99/190] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:04.858362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fcedc-4eb2-49e9-ab92-4ea835f5dc0f None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:04.885637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba3078-6be3-4fc5-aa49-66e393cd949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:04.886784 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3078-6be3-4fc5-aa49-66e393cd949d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:04.887168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3078-6be3-4fc5-aa49-66e393cd949d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:04.887633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3078-6be3-4fc5-aa49-66e393cd949d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:04.985365 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba3078-6be3-4fc5-aa49-66e393cd949d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:04.987969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba3078-6be3-4fc5-aa49-66e393cd949d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:05.006820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fcedc-4eb2-49e9-ab92-4ea835f5dc0f None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:05.042463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a93e4-476d-414b-bf30-66464b4c18b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:05.043374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a93e4-476d-414b-bf30-66464b4c18b8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.043660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a93e4-476d-414b-bf30-66464b4c18b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.043936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a93e4-476d-414b-bf30-66464b4c18b8 None admin] PATH_INFO: `/v3/users/708879e9da6444638f6aa6938bca820c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.045136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a93e4-476d-414b-bf30-66464b4c18b8 None admin] RBAC: Authorizing `identity:get_user(user_id=708879e9da6444638f6aa6938bca820c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:05.046620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a93e4-476d-414b-bf30-66464b4c18b8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:05.048297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 100/191] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:04 2022] GET /identity/v3/users/708879e9da6444638f6aa6938bca820c => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:05.049585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a908c-d5ed-4c5b-8e25-a9b1344463f4 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.049877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a908c-d5ed-4c5b-8e25-a9b1344463f4 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.050156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a908c-d5ed-4c5b-8e25-a9b1344463f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.066793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-008a908c-d5ed-4c5b-8e25-a9b1344463f4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:05.068034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-008a908c-d5ed-4c5b-8e25-a9b1344463f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:05.095714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 92/192] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:17:05.100657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202ebf-124f-4321-816e-da2bfcab09a1 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.100657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202ebf-124f-4321-816e-da2bfcab09a1 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.100657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202ebf-124f-4321-816e-da2bfcab09a1 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.100657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 93/193] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:05.100657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202ebf-124f-4321-816e-da2bfcab09a1 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:05.156522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 101/194] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:05.158146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a908c-d5ed-4c5b-8e25-a9b1344463f4 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:05.217872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202ebf-124f-4321-816e-da2bfcab09a1 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:05.253092 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e90a25-224f-4eda-aa90-b2ba97f82318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:05.254517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e90a25-224f-4eda-aa90-b2ba97f82318 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.255020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e90a25-224f-4eda-aa90-b2ba97f82318 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.255550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e90a25-224f-4eda-aa90-b2ba97f82318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.278538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a908c-d5ed-4c5b-8e25-a9b1344463f4 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:05.326375 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c67d7b-e14f-4d73-8f10-12c1b4c1ba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:05.327879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c67d7b-e14f-4d73-8f10-12c1b4c1ba1c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.328341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c67d7b-e14f-4d73-8f10-12c1b4c1ba1c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.328797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c67d7b-e14f-4d73-8f10-12c1b4c1ba1c None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.330248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c67d7b-e14f-4d73-8f10-12c1b4c1ba1c None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:05.331867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c67d7b-e14f-4d73-8f10-12c1b4c1ba1c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:05.333694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 102/195] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:05 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:05.334904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17bd58-5231-440f-9814-30440eeeffe5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.335221 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17bd58-5231-440f-9814-30440eeeffe5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.335504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17bd58-5231-440f-9814-30440eeeffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.352019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-be17bd58-5231-440f-9814-30440eeeffe5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:05.352301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e90a25-224f-4eda-aa90-b2ba97f82318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:05.353224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-be17bd58-5231-440f-9814-30440eeeffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:05.355103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e90a25-224f-4eda-aa90-b2ba97f82318 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:05.419098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 103/196] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:05.421149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17bd58-5231-440f-9814-30440eeeffe5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:05.485508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 94/197] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:05.486713 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e90a25-224f-4eda-aa90-b2ba97f82318 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:05.538665 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17bd58-5231-440f-9814-30440eeeffe5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:05.573044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92cc2d-5ac7-4608-a25b-973cbe7f6b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:05.573857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cc2d-5ac7-4608-a25b-973cbe7f6b4b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.574133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cc2d-5ac7-4608-a25b-973cbe7f6b4b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.574397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cc2d-5ac7-4608-a25b-973cbe7f6b4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.586357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92cc2d-5ac7-4608-a25b-973cbe7f6b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-2e92cc2d-5ac7-4608-a25b-973cbe7f6b4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:05.595150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:05.596554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:05.598026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 104/198] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:05.600134 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e90a25-224f-4eda-aa90-b2ba97f82318 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:05.600312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92cc2d-5ac7-4608-a25b-973cbe7f6b4b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:05.635436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c252058-91d2-4dd7-8467-4c1ad45320d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:05.635885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c252058-91d2-4dd7-8467-4c1ad45320d3 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.636163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c252058-91d2-4dd7-8467-4c1ad45320d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.636435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c252058-91d2-4dd7-8467-4c1ad45320d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.637358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c252058-91d2-4dd7-8467-4c1ad45320d3 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=4a5e849b81e744c08ab224f1f42af588, user.id=1d77c6ecd64d45148cd98e037b72e133) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:05.637671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c252058-91d2-4dd7-8467-4c1ad45320d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:05.639421 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c252058-91d2-4dd7-8467-4c1ad45320d3 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:05.645209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 95/199] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:05 2022] GET /identity/v3/role_assignments?user.id=1d77c6ecd64d45148cd98e037b72e133&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:05.645209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c252058-91d2-4dd7-8467-4c1ad45320d3 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:05.726536 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92cc2d-5ac7-4608-a25b-973cbe7f6b4b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:05.767571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08500-661e-4c6f-a677-e41ec727168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:05.768349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08500-661e-4c6f-a677-e41ec727168c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.768593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08500-661e-4c6f-a677-e41ec727168c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.768868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d08500-661e-4c6f-a677-e41ec727168c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.770156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08500-661e-4c6f-a677-e41ec727168c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:05.771955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d08500-661e-4c6f-a677-e41ec727168c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:05.773789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 105/200] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:05.774428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08500-661e-4c6f-a677-e41ec727168c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:05.785250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c252058-91d2-4dd7-8467-4c1ad45320d3 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:05.842590 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3ada3-e810-40e7-a8fa-db3e3b40bc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:05.844477 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ada3-e810-40e7-a8fa-db3e3b40bc56 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.844916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ada3-e810-40e7-a8fa-db3e3b40bc56 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.845352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ada3-e810-40e7-a8fa-db3e3b40bc56 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.847331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3ada3-e810-40e7-a8fa-db3e3b40bc56 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:05.849868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3ada3-e810-40e7-a8fa-db3e3b40bc56 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:05.857700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 96/201] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:05 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:05.857700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3ada3-e810-40e7-a8fa-db3e3b40bc56 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:05.898805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d08500-661e-4c6f-a677-e41ec727168c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:05.943296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084aca-de58-4ab3-b935-3880954a5aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:05.944310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084aca-de58-4ab3-b935-3880954a5aad None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:05.944754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084aca-de58-4ab3-b935-3880954a5aad None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:05.945196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1084aca-de58-4ab3-b935-3880954a5aad None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:05.946477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1084aca-de58-4ab3-b935-3880954a5aad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:05.946973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1084aca-de58-4ab3-b935-3880954a5aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:05.949393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1084aca-de58-4ab3-b935-3880954a5aad None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:05.963762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 106/202] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:05.965545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084aca-de58-4ab3-b935-3880954a5aad None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:05.990550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3ada3-e810-40e7-a8fa-db3e3b40bc56 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:06.024137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac0231-47e8-4a55-9850-f91ceb8f8b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:06.024731 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac0231-47e8-4a55-9850-f91ceb8f8b82 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:06.025017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac0231-47e8-4a55-9850-f91ceb8f8b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:06.025290 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac0231-47e8-4a55-9850-f91ceb8f8b82 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:06.025997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac0231-47e8-4a55-9850-f91ceb8f8b82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:06.027478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac0231-47e8-4a55-9850-f91ceb8f8b82 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:06.063065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 97/203] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:17:05 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:17:06.063065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac0231-47e8-4a55-9850-f91ceb8f8b82 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:06.116894 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1084aca-de58-4ab3-b935-3880954a5aad None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:06.157341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f31b3f-0e43-468c-8939-0d8ed60a6d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:06.158119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f31b3f-0e43-468c-8939-0d8ed60a6d8e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:06.158536 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f31b3f-0e43-468c-8939-0d8ed60a6d8e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:06.158892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f31b3f-0e43-468c-8939-0d8ed60a6d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:06.159954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f31b3f-0e43-468c-8939-0d8ed60a6d8e None admin] RBAC: Adding query filter params (role.id=f22059c052f142f7b64fe5c629e314c6, scope.project.id=540bf727f064487c930910ee34bc6da0, user.id=708879e9da6444638f6aa6938bca820c) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:06.160351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f31b3f-0e43-468c-8939-0d8ed60a6d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:06.161845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f31b3f-0e43-468c-8939-0d8ed60a6d8e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:06.170662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 107/204] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:05 2022] GET /identity/v3/role_assignments?user.id=708879e9da6444638f6aa6938bca820c&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=f22059c052f142f7b64fe5c629e314c6 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:06.203895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac0231-47e8-4a55-9850-f91ceb8f8b82 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:06.243978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3c6ca-175c-47af-9594-3e4faf3db162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:06.245199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3c6ca-175c-47af-9594-3e4faf3db162 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:06.245683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3c6ca-175c-47af-9594-3e4faf3db162 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:06.246112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3c6ca-175c-47af-9594-3e4faf3db162 None admin] PATH_INFO: `/v3/users/1d77c6ecd64d45148cd98e037b72e133` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:06.247809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3c6ca-175c-47af-9594-3e4faf3db162 None admin] RBAC: Authorizing `identity:get_user(user_id=1d77c6ecd64d45148cd98e037b72e133)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:06.250117 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3c6ca-175c-47af-9594-3e4faf3db162 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:06.252138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 98/205] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:06 2022] GET /identity/v3/users/1d77c6ecd64d45148cd98e037b72e133 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:06.262730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f31b3f-0e43-468c-8939-0d8ed60a6d8e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:06.374551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f31b3f-0e43-468c-8939-0d8ed60a6d8e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:06.417048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23ace6-5004-49e1-b826-de0918329577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:06.417719 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23ace6-5004-49e1-b826-de0918329577 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:06.418015 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23ace6-5004-49e1-b826-de0918329577 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:06.418399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23ace6-5004-49e1-b826-de0918329577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:06.513959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23ace6-5004-49e1-b826-de0918329577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:06.515618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23ace6-5004-49e1-b826-de0918329577 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:06.634755 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 108/206] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:06.641165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3c6ca-175c-47af-9594-3e4faf3db162 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:06.753917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3c6ca-175c-47af-9594-3e4faf3db162 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:06.788753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f73c4-539c-4b20-8388-46f4e4eb6423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:06.789624 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f73c4-539c-4b20-8388-46f4e4eb6423 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:06.789896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f73c4-539c-4b20-8388-46f4e4eb6423 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:06.790166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f73c4-539c-4b20-8388-46f4e4eb6423 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:06.791400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f73c4-539c-4b20-8388-46f4e4eb6423 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:06.792863 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f73c4-539c-4b20-8388-46f4e4eb6423 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:06.794729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 99/207] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:06 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:06.800819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23ace6-5004-49e1-b826-de0918329577 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:06.903671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23ace6-5004-49e1-b826-de0918329577 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:06.946529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544d7f4-13be-44fb-92cb-c2dd30b146c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:06.947233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544d7f4-13be-44fb-92cb-c2dd30b146c4 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:06.947514 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544d7f4-13be-44fb-92cb-c2dd30b146c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:06.947785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544d7f4-13be-44fb-92cb-c2dd30b146c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:06.948684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544d7f4-13be-44fb-92cb-c2dd30b146c4 None admin] RBAC: Adding query filter params (role.id=8b437ce0fad84637a68c6c151d4e2c5c, scope.project.id=4a5e849b81e744c08ab224f1f42af588, user.id=1d77c6ecd64d45148cd98e037b72e133) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:06.949003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544d7f4-13be-44fb-92cb-c2dd30b146c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:06.950479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544d7f4-13be-44fb-92cb-c2dd30b146c4 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:06.957293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 109/208] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:06 2022] GET /identity/v3/role_assignments?user.id=1d77c6ecd64d45148cd98e037b72e133&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=8b437ce0fad84637a68c6c151d4e2c5c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:08.080526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7aaa-f101-4e49-adff-0447efb19136 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:08.081541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7aaa-f101-4e49-adff-0447efb19136 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:08.082040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe7aaa-f101-4e49-adff-0447efb19136 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:08.083996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 100/209] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:08.090980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc411-7a31-4d22-bdb0-67244cebbd71 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:08.091920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc411-7a31-4d22-bdb0-67244cebbd71 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:08.092436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bc411-7a31-4d22-bdb0-67244cebbd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:08.111184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-461bc411-7a31-4d22-bdb0-67244cebbd71 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:08.112786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-461bc411-7a31-4d22-bdb0-67244cebbd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:08.188354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 110/210] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:08.218952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe7aaa-f101-4e49-adff-0447efb19136 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:08.330295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe7aaa-f101-4e49-adff-0447efb19136 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:08.365748 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f6889-f949-4728-ae57-d0ebfc573c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:08.366898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f6889-f949-4728-ae57-d0ebfc573c18 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:08.367407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f6889-f949-4728-ae57-d0ebfc573c18 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:08.367912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f6889-f949-4728-ae57-d0ebfc573c18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:08.379709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f6889-f949-4728-ae57-d0ebfc573c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-b11f6889-f949-4728-ae57-d0ebfc573c18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:08.387965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:08.388977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:08.390375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:08.392857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 101/211] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:17:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:08.399671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bc411-7a31-4d22-bdb0-67244cebbd71 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:08.513156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461bc411-7a31-4d22-bdb0-67244cebbd71 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:08.550480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57832872-39a7-44cb-8ab8-dc9020c1a404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:08.551192 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57832872-39a7-44cb-8ab8-dc9020c1a404 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:08.551478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57832872-39a7-44cb-8ab8-dc9020c1a404 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:08.551754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57832872-39a7-44cb-8ab8-dc9020c1a404 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:08.552520 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57832872-39a7-44cb-8ab8-dc9020c1a404 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:08.552827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57832872-39a7-44cb-8ab8-dc9020c1a404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:08.554222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57832872-39a7-44cb-8ab8-dc9020c1a404 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:08.563623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 111/212] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:08.569328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f6889-f949-4728-ae57-d0ebfc573c18 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:08.699827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b64325-781b-451d-abbc-8039271be642 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:08.700410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b64325-781b-451d-abbc-8039271be642 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:08.700852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f6889-f949-4728-ae57-d0ebfc573c18 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:08.700961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b64325-781b-451d-abbc-8039271be642 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:08.705294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 112/213] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:08.714153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ba27e-eece-48bf-8f54-5aa61c28fea4 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:08.714606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ba27e-eece-48bf-8f54-5aa61c28fea4 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:08.715372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ba27e-eece-48bf-8f54-5aa61c28fea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:08.742196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96de05-8f8d-4aa4-8220-9adaff178d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:08.743106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96de05-8f8d-4aa4-8220-9adaff178d58 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:08.743398 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96de05-8f8d-4aa4-8220-9adaff178d58 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:08.743678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96de05-8f8d-4aa4-8220-9adaff178d58 None admin] PATH_INFO: `/v3/users/1d77c6ecd64d45148cd98e037b72e133` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:08.744860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-d11ba27e-eece-48bf-8f54-5aa61c28fea4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:08.744970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96de05-8f8d-4aa4-8220-9adaff178d58 None admin] RBAC: Authorizing `identity:get_user(user_id=1d77c6ecd64d45148cd98e037b72e133)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:08.746386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96de05-8f8d-4aa4-8220-9adaff178d58 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:08.746845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d11ba27e-eece-48bf-8f54-5aa61c28fea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:08.748314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 102/214] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:08 2022] GET /identity/v3/users/1d77c6ecd64d45148cd98e037b72e133 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:08.758908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96de05-8f8d-4aa4-8220-9adaff178d58 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:08.866075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96de05-8f8d-4aa4-8220-9adaff178d58 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:08.875491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 113/215] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:08.909073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fb215-974f-49a6-bdbe-fd54fa9fa2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:08.910035 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb215-974f-49a6-bdbe-fd54fa9fa2d7 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:08.910323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb215-974f-49a6-bdbe-fd54fa9fa2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:08.910660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fb215-974f-49a6-bdbe-fd54fa9fa2d7 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:08.912030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fb215-974f-49a6-bdbe-fd54fa9fa2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:08.913738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fb215-974f-49a6-bdbe-fd54fa9fa2d7 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:08.915481 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ba27e-eece-48bf-8f54-5aa61c28fea4 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:08.915889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 103/216] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:08 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:08.925458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fb215-974f-49a6-bdbe-fd54fa9fa2d7 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:09.058570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fb215-974f-49a6-bdbe-fd54fa9fa2d7 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:09.079685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ba27e-eece-48bf-8f54-5aa61c28fea4 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:09.093866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059174f9-65a7-4da7-b018-5b2d6a33c187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:09.094782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059174f9-65a7-4da7-b018-5b2d6a33c187 None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.095084 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059174f9-65a7-4da7-b018-5b2d6a33c187 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.095368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059174f9-65a7-4da7-b018-5b2d6a33c187 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588/users/1d77c6ecd64d45148cd98e037b72e133/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.097377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059174f9-65a7-4da7-b018-5b2d6a33c187 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a5e849b81e744c08ab224f1f42af588, user_id=1d77c6ecd64d45148cd98e037b72e133, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:09.098847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059174f9-65a7-4da7-b018-5b2d6a33c187 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:09.113113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 104/217] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:17:08 2022] PUT /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588/users/1d77c6ecd64d45148cd98e037b72e133/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:17:09.124229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd718dc-00cf-4c23-acf7-1976d137375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:09.124767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7b5e-9eff-49f1-9495-f2abf1bc02ba None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.124995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7b5e-9eff-49f1-9495-f2abf1bc02ba None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.125089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd718dc-00cf-4c23-acf7-1976d137375c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.125270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7b5e-9eff-49f1-9495-f2abf1bc02ba None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.125360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd718dc-00cf-4c23-acf7-1976d137375c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.125538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd718dc-00cf-4c23-acf7-1976d137375c None admin] PATH_INFO: `/v3/domains/default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.126763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 105/218] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:09.131558 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd718dc-00cf-4c23-acf7-1976d137375c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:09.132797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1661bfc-a33e-4add-a4ec-235008f2bd04 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.133095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1661bfc-a33e-4add-a4ec-235008f2bd04 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.133247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd718dc-00cf-4c23-acf7-1976d137375c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:09.133395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1661bfc-a33e-4add-a4ec-235008f2bd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.140201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 114/219] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:09.141383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd718dc-00cf-4c23-acf7-1976d137375c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:09.165054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c1661bfc-a33e-4add-a4ec-235008f2bd04 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:09.166754 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c1661bfc-a33e-4add-a4ec-235008f2bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:09.255487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 106/220] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:09.274361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd718dc-00cf-4c23-acf7-1976d137375c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:09.289023 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1661bfc-a33e-4add-a4ec-235008f2bd04 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:09.314354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177818b6-509c-4d63-b651-e0b44b1007d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:09.315449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177818b6-509c-4d63-b651-e0b44b1007d7 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.315954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177818b6-509c-4d63-b651-e0b44b1007d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.316422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177818b6-509c-4d63-b651-e0b44b1007d7 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.317355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177818b6-509c-4d63-b651-e0b44b1007d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:09.319106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177818b6-509c-4d63-b651-e0b44b1007d7 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:09.348534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 115/221] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:17:09 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:17:09.390314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa24a5-a021-4237-af11-7c268a496304 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.390610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa24a5-a021-4237-af11-7c268a496304 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.390793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa24a5-a021-4237-af11-7c268a496304 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.395639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 116/222] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:09.400465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2ed6-9aff-4d58-99d6-378897c273d5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.400793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2ed6-9aff-4d58-99d6-378897c273d5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.401024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2ed6-9aff-4d58-99d6-378897c273d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.423668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-cc9d2ed6-9aff-4d58-99d6-378897c273d5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:09.425005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cc9d2ed6-9aff-4d58-99d6-378897c273d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:09.443811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1661bfc-a33e-4add-a4ec-235008f2bd04 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:09.494765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bca4-0b78-4a41-a8e7-da095f50ebbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:09.495626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bca4-0b78-4a41-a8e7-da095f50ebbe None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.495913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bca4-0b78-4a41-a8e7-da095f50ebbe None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.496189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1bca4-0b78-4a41-a8e7-da095f50ebbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.508805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1bca4-0b78-4a41-a8e7-da095f50ebbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-aff1bca4-0b78-4a41-a8e7-da095f50ebbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:09.517733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:09.518695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:09.519797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 107/223] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:09.520630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 117/224] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:09.527009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bca4-0b78-4a41-a8e7-da095f50ebbe None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:09.546228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d2ed6-9aff-4d58-99d6-378897c273d5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:09.661517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1bca4-0b78-4a41-a8e7-da095f50ebbe None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:09.691704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d2ed6-9aff-4d58-99d6-378897c273d5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:09.724843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9ec41-a9d6-4bd8-ab48-d0ab79d67271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:09.725532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9ec41-a9d6-4bd8-ab48-d0ab79d67271 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.725824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9ec41-a9d6-4bd8-ab48-d0ab79d67271 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.726112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9ec41-a9d6-4bd8-ab48-d0ab79d67271 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.726892 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9ec41-a9d6-4bd8-ab48-d0ab79d67271 None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:09.727234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9ec41-a9d6-4bd8-ab48-d0ab79d67271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:09.731283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9ec41-a9d6-4bd8-ab48-d0ab79d67271 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:09.741968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 108/225] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:09.748558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9ec41-a9d6-4bd8-ab48-d0ab79d67271 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:09.758594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2a6ce-df82-416e-8092-d244af3d4b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:09.759871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a6ce-df82-416e-8092-d244af3d4b4c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.760353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a6ce-df82-416e-8092-d244af3d4b4c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.760823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a6ce-df82-416e-8092-d244af3d4b4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.780700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2a6ce-df82-416e-8092-d244af3d4b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-bfc2a6ce-df82-416e-8092-d244af3d4b4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:09.792019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:09.793093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:09.793908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:09.797910 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 118/226] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:09.804039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2a6ce-df82-416e-8092-d244af3d4b4c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:09.894611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9ec41-a9d6-4bd8-ab48-d0ab79d67271 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:09.920358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2a6ce-df82-416e-8092-d244af3d4b4c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:09.933018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93a181-7f17-4a41-981f-a607e06add3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:09.933915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93a181-7f17-4a41-981f-a607e06add3d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.934205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93a181-7f17-4a41-981f-a607e06add3d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.934488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93a181-7f17-4a41-981f-a607e06add3d None admin] PATH_INFO: `/v3/users/1673dfc6730b43beb31ca12415b442dd` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.950262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93a181-7f17-4a41-981f-a607e06add3d None admin] RBAC: Authorizing `identity:get_user(user_id=1673dfc6730b43beb31ca12415b442dd)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:09.951823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93a181-7f17-4a41-981f-a607e06add3d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:09.959153 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 109/227] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:09 2022] GET /identity/v3/users/1673dfc6730b43beb31ca12415b442dd => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:09.962703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93a181-7f17-4a41-981f-a607e06add3d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:09.964771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4e45d-d6b6-40d3-a6e1-90ae9ed9f802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:09.965479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4e45d-d6b6-40d3-a6e1-90ae9ed9f802 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:09.965770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4e45d-d6b6-40d3-a6e1-90ae9ed9f802 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:09.966109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4e45d-d6b6-40d3-a6e1-90ae9ed9f802 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:09.966895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4e45d-d6b6-40d3-a6e1-90ae9ed9f802 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:09.969277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4e45d-d6b6-40d3-a6e1-90ae9ed9f802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:09.970737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4e45d-d6b6-40d3-a6e1-90ae9ed9f802 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:09.981075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 119/228] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:09.987553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4e45d-d6b6-40d3-a6e1-90ae9ed9f802 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:10.073051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93a181-7f17-4a41-981f-a607e06add3d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:10.096324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4e45d-d6b6-40d3-a6e1-90ae9ed9f802 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:10.121142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a66cde-1d2f-49cf-ad7c-d0a982a1af7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:10.122177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a66cde-1d2f-49cf-ad7c-d0a982a1af7e None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:10.122629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a66cde-1d2f-49cf-ad7c-d0a982a1af7e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:10.123090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a66cde-1d2f-49cf-ad7c-d0a982a1af7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:10.133273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a9e10-d8b6-48c2-9acb-b044514e90a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:10.134170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a9e10-d8b6-48c2-9acb-b044514e90a5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:10.134453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a9e10-d8b6-48c2-9acb-b044514e90a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:10.134796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a9e10-d8b6-48c2-9acb-b044514e90a5 None admin] PATH_INFO: `/v3/users/1d77c6ecd64d45148cd98e037b72e133` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:10.136175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a9e10-d8b6-48c2-9acb-b044514e90a5 None admin] RBAC: Authorizing `identity:get_user(user_id=1d77c6ecd64d45148cd98e037b72e133)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:10.137927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a9e10-d8b6-48c2-9acb-b044514e90a5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:10.140542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 120/229] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:09 2022] GET /identity/v3/users/1d77c6ecd64d45148cd98e037b72e133 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:10.146979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a9e10-d8b6-48c2-9acb-b044514e90a5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:10.216484 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a66cde-1d2f-49cf-ad7c-d0a982a1af7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:10.218971 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a66cde-1d2f-49cf-ad7c-d0a982a1af7e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:10.276599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a9e10-d8b6-48c2-9acb-b044514e90a5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:10.312271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b911300-e9dd-4ab9-8bd5-0e075b64812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:10.313149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b911300-e9dd-4ab9-8bd5-0e075b64812d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:10.313432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b911300-e9dd-4ab9-8bd5-0e075b64812d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:10.313705 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b911300-e9dd-4ab9-8bd5-0e075b64812d None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:10.314961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b911300-e9dd-4ab9-8bd5-0e075b64812d None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:10.316484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b911300-e9dd-4ab9-8bd5-0e075b64812d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:10.318556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 121/230] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:10 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:10.324181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b911300-e9dd-4ab9-8bd5-0e075b64812d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:10.353211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 110/231] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:10.354557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a66cde-1d2f-49cf-ad7c-d0a982a1af7e None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:10.433675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b911300-e9dd-4ab9-8bd5-0e075b64812d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:10.479983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e71d67-e052-45d9-a944-f3cdbd7053fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:10.480822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71d67-e052-45d9-a944-f3cdbd7053fd None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:10.481110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71d67-e052-45d9-a944-f3cdbd7053fd None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:10.481387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e71d67-e052-45d9-a944-f3cdbd7053fd None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588/users/1d77c6ecd64d45148cd98e037b72e133/roles/8b437ce0fad84637a68c6c151d4e2c5c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:10.488723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e71d67-e052-45d9-a944-f3cdbd7053fd None admin] RBAC: Authorizing `identity:create_grant(project_id=4a5e849b81e744c08ab224f1f42af588, user_id=1d77c6ecd64d45148cd98e037b72e133, role_id=8b437ce0fad84637a68c6c151d4e2c5c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:10.490235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e71d67-e052-45d9-a944-f3cdbd7053fd None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:10.501786 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a66cde-1d2f-49cf-ad7c-d0a982a1af7e None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:10.518319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 122/232] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:17:10 2022] PUT /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588/users/1d77c6ecd64d45148cd98e037b72e133/roles/8b437ce0fad84637a68c6c151d4e2c5c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:17:10.565724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d35e00-3e22-4c14-ab8c-25471d01aaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:10.566627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d35e00-3e22-4c14-ab8c-25471d01aaf8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:10.566975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d35e00-3e22-4c14-ab8c-25471d01aaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:10.567284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d35e00-3e22-4c14-ab8c-25471d01aaf8 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:10.571512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d35e00-3e22-4c14-ab8c-25471d01aaf8 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:10.573151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d35e00-3e22-4c14-ab8c-25471d01aaf8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:10.575461 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 111/233] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:10 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:10.581954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e71d67-e052-45d9-a944-f3cdbd7053fd None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:10.736986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e71d67-e052-45d9-a944-f3cdbd7053fd None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:10.779985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058450b-88ed-43cc-9a97-3274ab55e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:10.781549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058450b-88ed-43cc-9a97-3274ab55e8d1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:10.781549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058450b-88ed-43cc-9a97-3274ab55e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:10.781549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058450b-88ed-43cc-9a97-3274ab55e8d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:10.782611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058450b-88ed-43cc-9a97-3274ab55e8d1 None admin] RBAC: Adding query filter params (role.id=2d441060f04441848c895dc5b9affb06, scope.project.id=4a5e849b81e744c08ab224f1f42af588, user.id=1673dfc6730b43beb31ca12415b442dd) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:10.782928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058450b-88ed-43cc-9a97-3274ab55e8d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:10.784533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058450b-88ed-43cc-9a97-3274ab55e8d1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:10.791548 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 123/234] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:10 2022] GET /identity/v3/role_assignments?user.id=1673dfc6730b43beb31ca12415b442dd&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=2d441060f04441848c895dc5b9affb06 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:12.253143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d00588-ee05-469f-8cc4-3dd76e38ac89 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:12.253826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d00588-ee05-469f-8cc4-3dd76e38ac89 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:12.253826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d00588-ee05-469f-8cc4-3dd76e38ac89 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:12.255281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 112/235] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:12.269343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ab5f-ef20-47d2-b325-0d608cab4575 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:12.269925 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ab5f-ef20-47d2-b325-0d608cab4575 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:12.269925 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ab5f-ef20-47d2-b325-0d608cab4575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:12.292078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-3005ab5f-ef20-47d2-b325-0d608cab4575 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:12.293307 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-3005ab5f-ef20-47d2-b325-0d608cab4575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:12.371518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 124/236] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:12.406799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d00588-ee05-469f-8cc4-3dd76e38ac89 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:12.447163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb156901-ac02-48ba-9c9b-f2e4fb34678d None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:12.447800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb156901-ac02-48ba-9c9b-f2e4fb34678d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:12.448282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb156901-ac02-48ba-9c9b-f2e4fb34678d None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:12.450276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 125/237] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:12.457127 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926f84-c0bd-41f6-814a-bb4b4fd4604e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:12.457752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926f84-c0bd-41f6-814a-bb4b4fd4604e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:12.458257 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e926f84-c0bd-41f6-814a-bb4b4fd4604e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:12.491631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2e926f84-c0bd-41f6-814a-bb4b4fd4604e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:12.493208 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2e926f84-c0bd-41f6-814a-bb4b4fd4604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:12.549716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d00588-ee05-469f-8cc4-3dd76e38ac89 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:12.614161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 126/238] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:12.641184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c5a55-c4be-46ec-9013-15a6a75587a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:12.642498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c5a55-c4be-46ec-9013-15a6a75587a0 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:12.642974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c5a55-c4be-46ec-9013-15a6a75587a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:12.643458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c5a55-c4be-46ec-9013-15a6a75587a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:12.659950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926f84-c0bd-41f6-814a-bb4b4fd4604e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:12.662220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c5a55-c4be-46ec-9013-15a6a75587a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-958c5a55-c4be-46ec-9013-15a6a75587a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:12.674280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:12.675263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:12.676062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 113/239] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:12.683006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c5a55-c4be-46ec-9013-15a6a75587a0 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:12.775597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e926f84-c0bd-41f6-814a-bb4b4fd4604e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:12.811789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f0805-decb-482b-b679-3c90e0d1cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:12.812789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f0805-decb-482b-b679-3c90e0d1cea8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:12.813168 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f0805-decb-482b-b679-3c90e0d1cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:12.813784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f0805-decb-482b-b679-3c90e0d1cea8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:12.828642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f0805-decb-482b-b679-3c90e0d1cea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:12.832044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c5a55-c4be-46ec-9013-15a6a75587a0 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-b27f0805-decb-482b-b679-3c90e0d1cea8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:12.838249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:12.840613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 127/240] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:12.842565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102d31d-ac82-4cd5-aff4-3a17787c6c73 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:12.844687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102d31d-ac82-4cd5-aff4-3a17787c6c73 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:12.844687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102d31d-ac82-4cd5-aff4-3a17787c6c73 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:12.844687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 128/241] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:12.851076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102d31d-ac82-4cd5-aff4-3a17787c6c73 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:12.884031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729535d-5a2f-4176-959a-a81264f13823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:12.884733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729535d-5a2f-4176-959a-a81264f13823 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:12.885022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729535d-5a2f-4176-959a-a81264f13823 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:12.885367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729535d-5a2f-4176-959a-a81264f13823 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:12.886282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729535d-5a2f-4176-959a-a81264f13823 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:12.886597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729535d-5a2f-4176-959a-a81264f13823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:12.890304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729535d-5a2f-4176-959a-a81264f13823 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:12.910247 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 114/242] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:12.912356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12132042-67f6-47b1-9b06-4dfffd8c93f3 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:12.912643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12132042-67f6-47b1-9b06-4dfffd8c93f3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:12.912920 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12132042-67f6-47b1-9b06-4dfffd8c93f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:12.947269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-12132042-67f6-47b1-9b06-4dfffd8c93f3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:12.948813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-12132042-67f6-47b1-9b06-4dfffd8c93f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:12.970740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102d31d-ac82-4cd5-aff4-3a17787c6c73 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:13.007422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c9696-b843-4fad-9de0-5ab002cc58f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:13.008384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9696-b843-4fad-9de0-5ab002cc58f5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:13.008872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9696-b843-4fad-9de0-5ab002cc58f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:13.009290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c9696-b843-4fad-9de0-5ab002cc58f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:13.010234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c9696-b843-4fad-9de0-5ab002cc58f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:13.010772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c9696-b843-4fad-9de0-5ab002cc58f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:13.012343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c9696-b843-4fad-9de0-5ab002cc58f5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:13.022746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 129/243] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:13.023871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c9696-b843-4fad-9de0-5ab002cc58f5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:13.046580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 115/244] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:13.046580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12132042-67f6-47b1-9b06-4dfffd8c93f3 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:13.148822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12132042-67f6-47b1-9b06-4dfffd8c93f3 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:13.160508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c9696-b843-4fad-9de0-5ab002cc58f5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:13.184853 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a5603-9fe7-479e-b2b7-433dfa29cc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:13.185741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a5603-9fe7-479e-b2b7-433dfa29cc47 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:13.186965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a5603-9fe7-479e-b2b7-433dfa29cc47 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:13.187287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a5603-9fe7-479e-b2b7-433dfa29cc47 None admin] PATH_INFO: `/v3/users/5e106f525a444eeb8aecb51f56c4bce6` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:13.197277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4fca8-42c0-462f-b7c7-0e90923f1c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:13.198460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4fca8-42c0-462f-b7c7-0e90923f1c12 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:13.198945 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4fca8-42c0-462f-b7c7-0e90923f1c12 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:13.199447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4fca8-42c0-462f-b7c7-0e90923f1c12 None admin] PATH_INFO: `/v3/users/1d77c6ecd64d45148cd98e037b72e133` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:13.200827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4fca8-42c0-462f-b7c7-0e90923f1c12 None admin] RBAC: Authorizing `identity:get_user(user_id=1d77c6ecd64d45148cd98e037b72e133)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:13.203261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4fca8-42c0-462f-b7c7-0e90923f1c12 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:13.203638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a5603-9fe7-479e-b2b7-433dfa29cc47 None admin] RBAC: Authorizing `identity:get_user(user_id=5e106f525a444eeb8aecb51f56c4bce6)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:13.205117 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a5603-9fe7-479e-b2b7-433dfa29cc47 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:13.205501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 130/245] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:13 2022] GET /identity/v3/users/1d77c6ecd64d45148cd98e037b72e133 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:13.206496 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4fca8-42c0-462f-b7c7-0e90923f1c12 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:13.211292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 116/246] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:13 2022] GET /identity/v3/users/5e106f525a444eeb8aecb51f56c4bce6 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:13.213816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a5603-9fe7-479e-b2b7-433dfa29cc47 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:13.350993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4fca8-42c0-462f-b7c7-0e90923f1c12 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:13.364676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a5603-9fe7-479e-b2b7-433dfa29cc47 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:13.398337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c4743-af68-4a2a-89ae-0afb9e33347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:13.399800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c4743-af68-4a2a-89ae-0afb9e33347f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:13.400325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c4743-af68-4a2a-89ae-0afb9e33347f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:13.400851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c4743-af68-4a2a-89ae-0afb9e33347f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:13.402856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c4743-af68-4a2a-89ae-0afb9e33347f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:13.405231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6dd9-9b2d-4e2f-8f82-ff9ec4d03bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:13.405913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6dd9-9b2d-4e2f-8f82-ff9ec4d03bdb None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:13.406199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6dd9-9b2d-4e2f-8f82-ff9ec4d03bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:13.406481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad6dd9-9b2d-4e2f-8f82-ff9ec4d03bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:13.407066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c4743-af68-4a2a-89ae-0afb9e33347f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:13.410171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 131/247] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:13.414574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c4743-af68-4a2a-89ae-0afb9e33347f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:13.480612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad6dd9-9b2d-4e2f-8f82-ff9ec4d03bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:13.482241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad6dd9-9b2d-4e2f-8f82-ff9ec4d03bdb None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:13.571377 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c4743-af68-4a2a-89ae-0afb9e33347f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:13.600301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 117/248] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:17:13.601200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6dd9-9b2d-4e2f-8f82-ff9ec4d03bdb None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:13.621500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64bea7-ebdf-4d05-8182-4f7a85d3f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:13.622165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64bea7-ebdf-4d05-8182-4f7a85d3f136 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:13.622452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64bea7-ebdf-4d05-8182-4f7a85d3f136 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:13.622730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64bea7-ebdf-4d05-8182-4f7a85d3f136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:13.697426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64bea7-ebdf-4d05-8182-4f7a85d3f136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:13.699296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64bea7-ebdf-4d05-8182-4f7a85d3f136 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:13.721375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad6dd9-9b2d-4e2f-8f82-ff9ec4d03bdb None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:13.759456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64899fb-05a9-474e-86cf-72e8119dabaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:13.760152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64899fb-05a9-474e-86cf-72e8119dabaf None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:13.760425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64899fb-05a9-474e-86cf-72e8119dabaf None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:13.760700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64899fb-05a9-474e-86cf-72e8119dabaf None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:13.761411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64899fb-05a9-474e-86cf-72e8119dabaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:13.762866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64899fb-05a9-474e-86cf-72e8119dabaf None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:13.803063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 118/249] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:17:13 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:17:13.803063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dcdc6-a3e7-4846-a471-da1c31ab7ce8 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:13.803063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dcdc6-a3e7-4846-a471-da1c31ab7ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:13.803063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dcdc6-a3e7-4846-a471-da1c31ab7ce8 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:13.803063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 119/250] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:13.803063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dcdc6-a3e7-4846-a471-da1c31ab7ce8 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:13.824489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 132/251] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:13.825896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331182-a3a8-4729-a238-994b56c188e8 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:13.826187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331182-a3a8-4729-a238-994b56c188e8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:13.826661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331182-a3a8-4729-a238-994b56c188e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:13.857243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-e8331182-a3a8-4729-a238-994b56c188e8 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:13.864799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e8331182-a3a8-4729-a238-994b56c188e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:13.947959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 133/252] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:13.955367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dcdc6-a3e7-4846-a471-da1c31ab7ce8 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:13.956091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8331182-a3a8-4729-a238-994b56c188e8 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:13.993519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1d1b4-7b04-4606-966b-d83a01f79a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:13.994393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1d1b4-7b04-4606-966b-d83a01f79a47 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:13.994678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1d1b4-7b04-4606-966b-d83a01f79a47 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:13.994952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1d1b4-7b04-4606-966b-d83a01f79a47 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:13.996264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1d1b4-7b04-4606-966b-d83a01f79a47 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:13.997816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d1d1b4-7b04-4606-966b-d83a01f79a47 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:14.000721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 120/253] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:13 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:14.001986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80b6b-10a5-4474-bc53-daeb1ec21c37 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:14.002418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80b6b-10a5-4474-bc53-daeb1ec21c37 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:14.002813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d80b6b-10a5-4474-bc53-daeb1ec21c37 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:14.007545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 121/254] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:14.007545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80b6b-10a5-4474-bc53-daeb1ec21c37 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:14.081929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8331182-a3a8-4729-a238-994b56c188e8 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:14.124350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d80b6b-10a5-4474-bc53-daeb1ec21c37 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:14.129765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbebcfc-eaf0-43bd-8ae4-67792763fdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:14.130641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbebcfc-eaf0-43bd-8ae4-67792763fdda None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:14.130927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbebcfc-eaf0-43bd-8ae4-67792763fdda None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:14.131421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbebcfc-eaf0-43bd-8ae4-67792763fdda None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:14.132442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbebcfc-eaf0-43bd-8ae4-67792763fdda None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:14.134153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbebcfc-eaf0-43bd-8ae4-67792763fdda None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:14.137198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 134/255] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:13 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:14.137198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbebcfc-eaf0-43bd-8ae4-67792763fdda None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:14.172539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c7de4-388e-4d0a-9628-2d456bd042ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:14.173348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c7de4-388e-4d0a-9628-2d456bd042ff None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:14.173633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c7de4-388e-4d0a-9628-2d456bd042ff None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:14.174026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c7de4-388e-4d0a-9628-2d456bd042ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:14.187317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c7de4-388e-4d0a-9628-2d456bd042ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-527c7de4-388e-4d0a-9628-2d456bd042ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:14.196370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:14.197473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:14.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:14.200512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 122/256] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:14.201956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8492590-3ffc-49fe-be7c-188d5eb16f6e None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:14.202896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8492590-3ffc-49fe-be7c-188d5eb16f6e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:14.203356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8492590-3ffc-49fe-be7c-188d5eb16f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:14.225782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c8492590-3ffc-49fe-be7c-188d5eb16f6e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:14.227007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c8492590-3ffc-49fe-be7c-188d5eb16f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:14.269428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbebcfc-eaf0-43bd-8ae4-67792763fdda None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:14.319516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f0cbf-2c1c-4d48-9e44-41f5b25729a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:14.320563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f0cbf-2c1c-4d48-9e44-41f5b25729a5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:14.321161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f0cbf-2c1c-4d48-9e44-41f5b25729a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:14.321701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f0cbf-2c1c-4d48-9e44-41f5b25729a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:14.323234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f0cbf-2c1c-4d48-9e44-41f5b25729a5 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=4a5e849b81e744c08ab224f1f42af588, user.id=1d77c6ecd64d45148cd98e037b72e133) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:14.323776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f0cbf-2c1c-4d48-9e44-41f5b25729a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:14.325589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f0cbf-2c1c-4d48-9e44-41f5b25729a5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:14.333875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 135/257] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:14 2022] GET /identity/v3/role_assignments?user.id=1d77c6ecd64d45148cd98e037b72e133&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:14.335184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f0cbf-2c1c-4d48-9e44-41f5b25729a5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:14.335627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 123/258] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:14.337023 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8492590-3ffc-49fe-be7c-188d5eb16f6e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:14.445653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f0cbf-2c1c-4d48-9e44-41f5b25729a5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:14.450015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8492590-3ffc-49fe-be7c-188d5eb16f6e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:14.484391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c54eaf-3818-4d43-93df-0c4ab3c01933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:14.485636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c54eaf-3818-4d43-93df-0c4ab3c01933 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:14.486193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c54eaf-3818-4d43-93df-0c4ab3c01933 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:14.486904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c54eaf-3818-4d43-93df-0c4ab3c01933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:14.487925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189783e5-c3f8-4dff-a800-7b30eb98959a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:14.488325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c54eaf-3818-4d43-93df-0c4ab3c01933 None admin] RBAC: Adding query filter params (role.id=f22059c052f142f7b64fe5c629e314c6, scope.project.id=4a5e849b81e744c08ab224f1f42af588, user.id=5e106f525a444eeb8aecb51f56c4bce6) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:14.488608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189783e5-c3f8-4dff-a800-7b30eb98959a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:14.488895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189783e5-c3f8-4dff-a800-7b30eb98959a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:14.489176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189783e5-c3f8-4dff-a800-7b30eb98959a None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:14.489443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c54eaf-3818-4d43-93df-0c4ab3c01933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:14.489939 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189783e5-c3f8-4dff-a800-7b30eb98959a None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:14.490250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189783e5-c3f8-4dff-a800-7b30eb98959a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:14.491572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c54eaf-3818-4d43-93df-0c4ab3c01933 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:14.491695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189783e5-c3f8-4dff-a800-7b30eb98959a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:14.498048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 136/259] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:14 2022] GET /identity/v3/role_assignments?user.id=5e106f525a444eeb8aecb51f56c4bce6&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=f22059c052f142f7b64fe5c629e314c6 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:14.499781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c54eaf-3818-4d43-93df-0c4ab3c01933 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:14.502120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 124/260] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:14.512218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189783e5-c3f8-4dff-a800-7b30eb98959a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:14.612594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c54eaf-3818-4d43-93df-0c4ab3c01933 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:14.651869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f1111-1f8d-4231-a983-de184f23a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:14.653057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f1111-1f8d-4231-a983-de184f23a57f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:14.653564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f1111-1f8d-4231-a983-de184f23a57f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:14.654064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f1111-1f8d-4231-a983-de184f23a57f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:14.666096 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f1111-1f8d-4231-a983-de184f23a57f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-841f1111-1f8d-4231-a983-de184f23a57f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:14.674832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:14.676029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:14.676815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:14.679388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 137/261] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:14.685851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f1111-1f8d-4231-a983-de184f23a57f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:14.707616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189783e5-c3f8-4dff-a800-7b30eb98959a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:14.772240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ff997-bfcc-4410-852d-ffbc28abc709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:14.773174 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff997-bfcc-4410-852d-ffbc28abc709 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:14.773459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff997-bfcc-4410-852d-ffbc28abc709 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:14.773738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ff997-bfcc-4410-852d-ffbc28abc709 None admin] PATH_INFO: `/v3/users/1673dfc6730b43beb31ca12415b442dd` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:14.780655 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ff997-bfcc-4410-852d-ffbc28abc709 None admin] RBAC: Authorizing `identity:get_user(user_id=1673dfc6730b43beb31ca12415b442dd)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:14.782209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ff997-bfcc-4410-852d-ffbc28abc709 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:14.784231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 125/262] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:14 2022] GET /identity/v3/users/1673dfc6730b43beb31ca12415b442dd => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:14.791369 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ff997-bfcc-4410-852d-ffbc28abc709 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:14.807292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f1111-1f8d-4231-a983-de184f23a57f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:14.881694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc177e1-3eb2-4273-8ce6-04d2531b6033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:14.882800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc177e1-3eb2-4273-8ce6-04d2531b6033 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:14.883318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc177e1-3eb2-4273-8ce6-04d2531b6033 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:14.885987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc177e1-3eb2-4273-8ce6-04d2531b6033 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:14.887138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc177e1-3eb2-4273-8ce6-04d2531b6033 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:14.887656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc177e1-3eb2-4273-8ce6-04d2531b6033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:14.889293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc177e1-3eb2-4273-8ce6-04d2531b6033 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:14.907240 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 138/263] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:14.914092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc177e1-3eb2-4273-8ce6-04d2531b6033 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:15.018466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ff997-bfcc-4410-852d-ffbc28abc709 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:15.102610 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251e9a-37ab-4740-a031-ffe68bc2a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:15.104343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251e9a-37ab-4740-a031-ffe68bc2a727 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:15.104993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251e9a-37ab-4740-a031-ffe68bc2a727 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:15.107605 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251e9a-37ab-4740-a031-ffe68bc2a727 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:15.111719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251e9a-37ab-4740-a031-ffe68bc2a727 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:15.118967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251e9a-37ab-4740-a031-ffe68bc2a727 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:15.122279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 126/264] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:14 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:15.131250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251e9a-37ab-4740-a031-ffe68bc2a727 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:15.150506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc177e1-3eb2-4273-8ce6-04d2531b6033 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:15.229594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62aced-494d-4d3b-bdc3-7101e00efc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:15.230614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62aced-494d-4d3b-bdc3-7101e00efc0c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:15.231001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62aced-494d-4d3b-bdc3-7101e00efc0c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:15.231398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62aced-494d-4d3b-bdc3-7101e00efc0c None admin] PATH_INFO: `/v3/users/1d77c6ecd64d45148cd98e037b72e133` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:15.232764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62aced-494d-4d3b-bdc3-7101e00efc0c None admin] RBAC: Authorizing `identity:get_user(user_id=1d77c6ecd64d45148cd98e037b72e133)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:15.234927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62aced-494d-4d3b-bdc3-7101e00efc0c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:15.245372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 139/265] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:14 2022] GET /identity/v3/users/1d77c6ecd64d45148cd98e037b72e133 => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:15.251684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62aced-494d-4d3b-bdc3-7101e00efc0c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:15.293516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251e9a-37ab-4740-a031-ffe68bc2a727 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:15.348693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fca29-3b61-42c0-ad4d-be96ecc1d0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:15.350072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fca29-3b61-42c0-ad4d-be96ecc1d0ab None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:15.350808 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fca29-3b61-42c0-ad4d-be96ecc1d0ab None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:15.351454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fca29-3b61-42c0-ad4d-be96ecc1d0ab None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588/users/1673dfc6730b43beb31ca12415b442dd/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:15.358643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fca29-3b61-42c0-ad4d-be96ecc1d0ab None admin] RBAC: Authorizing `identity:create_grant(project_id=4a5e849b81e744c08ab224f1f42af588, user_id=1673dfc6730b43beb31ca12415b442dd, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:15.360390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fca29-3b61-42c0-ad4d-be96ecc1d0ab None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:15.384788 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 127/266] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:17:15 2022] PUT /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588/users/1673dfc6730b43beb31ca12415b442dd/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:17:15.430883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62aced-494d-4d3b-bdc3-7101e00efc0c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:15.481646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb18b-efbf-4c07-9b2e-7be809c3ed83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:15.483265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb18b-efbf-4c07-9b2e-7be809c3ed83 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:15.483749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb18b-efbf-4c07-9b2e-7be809c3ed83 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:15.484216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb18b-efbf-4c07-9b2e-7be809c3ed83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:15.570101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb18b-efbf-4c07-9b2e-7be809c3ed83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:15.573214 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb18b-efbf-4c07-9b2e-7be809c3ed83 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:15.757575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 140/267] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:15.764979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fca29-3b61-42c0-ad4d-be96ecc1d0ab None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:15.893818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fca29-3b61-42c0-ad4d-be96ecc1d0ab None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:15.940034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477e8f0-a14c-46ff-94e4-f5ca63780acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:15.940923 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e8f0-a14c-46ff-94e4-f5ca63780acb None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:15.941203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e8f0-a14c-46ff-94e4-f5ca63780acb None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:15.941484 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e8f0-a14c-46ff-94e4-f5ca63780acb None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:15.946445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477e8f0-a14c-46ff-94e4-f5ca63780acb None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:15.947986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477e8f0-a14c-46ff-94e4-f5ca63780acb None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:15.949759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 128/268] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:15 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:15.956506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb18b-efbf-4c07-9b2e-7be809c3ed83 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:16.140193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb18b-efbf-4c07-9b2e-7be809c3ed83 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:16.184282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44129464-c738-44f3-a7d5-d0894896633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:16.184952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129464-c738-44f3-a7d5-d0894896633b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:16.185394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129464-c738-44f3-a7d5-d0894896633b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:16.185684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44129464-c738-44f3-a7d5-d0894896633b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:16.187386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44129464-c738-44f3-a7d5-d0894896633b None admin] RBAC: Adding query filter params (role.id=8b437ce0fad84637a68c6c151d4e2c5c, scope.project.id=4a5e849b81e744c08ab224f1f42af588, user.id=1d77c6ecd64d45148cd98e037b72e133) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:16.187698 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44129464-c738-44f3-a7d5-d0894896633b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:16.189152 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44129464-c738-44f3-a7d5-d0894896633b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:16.200389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 141/269] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:15 2022] GET /identity/v3/role_assignments?user.id=1d77c6ecd64d45148cd98e037b72e133&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=8b437ce0fad84637a68c6c151d4e2c5c => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:17.571872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6198653-1587-48dc-96b2-8037c2c2079a None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:17.572646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6198653-1587-48dc-96b2-8037c2c2079a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:17.572646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6198653-1587-48dc-96b2-8037c2c2079a None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:17.573817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 129/270] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:17.582226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109458ce-69a8-4394-a86f-892dcd3c5f37 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:17.582702 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109458ce-69a8-4394-a86f-892dcd3c5f37 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:17.582775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109458ce-69a8-4394-a86f-892dcd3c5f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:17.599962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-109458ce-69a8-4394-a86f-892dcd3c5f37 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:17.601154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-109458ce-69a8-4394-a86f-892dcd3c5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:17.683993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 142/271] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:17.688522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213a6b-dfc0-47b8-8f33-8ad94cd318e3 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:17.688811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213a6b-dfc0-47b8-8f33-8ad94cd318e3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:17.689090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213a6b-dfc0-47b8-8f33-8ad94cd318e3 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:17.690455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 130/272] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:17.701071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec55daa-9e1d-4ea4-a5cf-dfcc829371e4 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:17.701359 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec55daa-9e1d-4ea4-a5cf-dfcc829371e4 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:17.701634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec55daa-9e1d-4ea4-a5cf-dfcc829371e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:17.726269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61213a6b-dfc0-47b8-8f33-8ad94cd318e3 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:17.729276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2ec55daa-9e1d-4ea4-a5cf-dfcc829371e4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:17.735256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2ec55daa-9e1d-4ea4-a5cf-dfcc829371e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:17.833303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 143/273] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:17.834846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fff08-4ba3-4d9a-be1a-82995b579ff8 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:17.835372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fff08-4ba3-4d9a-be1a-82995b579ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:17.835843 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fff08-4ba3-4d9a-be1a-82995b579ff8 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:17.841932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 144/274] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:17.843666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368d54-59b9-4e3b-9873-3d31355c9fd5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:17.844190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368d54-59b9-4e3b-9873-3d31355c9fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:17.844729 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b368d54-59b9-4e3b-9873-3d31355c9fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:17.873024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61213a6b-dfc0-47b8-8f33-8ad94cd318e3 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:17.879071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-1b368d54-59b9-4e3b-9873-3d31355c9fd5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:17.880586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1b368d54-59b9-4e3b-9873-3d31355c9fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:17.910621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd1293-4854-47ee-ae46-7e276a7520f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:17.911962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd1293-4854-47ee-ae46-7e276a7520f1 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:17.912549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd1293-4854-47ee-ae46-7e276a7520f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:17.912928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd1293-4854-47ee-ae46-7e276a7520f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:17.932545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd1293-4854-47ee-ae46-7e276a7520f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-87dd1293-4854-47ee-ae46-7e276a7520f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:17.953024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:17.954001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:17.954791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:17.956632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 131/275] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:17.958205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd1293-4854-47ee-ae46-7e276a7520f1 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:17.995087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 145/276] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:17.995087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368d54-59b9-4e3b-9873-3d31355c9fd5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:18.084713 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd1293-4854-47ee-ae46-7e276a7520f1 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:18.125206 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4c06b-5853-42fe-a570-a6fb5bad9435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:18.126000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4c06b-5853-42fe-a570-a6fb5bad9435 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.126291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4c06b-5853-42fe-a570-a6fb5bad9435 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.126564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4c06b-5853-42fe-a570-a6fb5bad9435 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.127813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4c06b-5853-42fe-a570-a6fb5bad9435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:18.129268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4c06b-5853-42fe-a570-a6fb5bad9435 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:18.130892 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 132/277] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:18.131695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4c06b-5853-42fe-a570-a6fb5bad9435 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:18.153773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b368d54-59b9-4e3b-9873-3d31355c9fd5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:18.192095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c95aaf-ef16-421f-8bd7-de7a14b10f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:18.192770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c95aaf-ef16-421f-8bd7-de7a14b10f17 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.193047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c95aaf-ef16-421f-8bd7-de7a14b10f17 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.193644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c95aaf-ef16-421f-8bd7-de7a14b10f17 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.194075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c95aaf-ef16-421f-8bd7-de7a14b10f17 None admin] RBAC: Adding query filter params (name=member) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:18.194381 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c95aaf-ef16-421f-8bd7-de7a14b10f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:18.198856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c95aaf-ef16-421f-8bd7-de7a14b10f17 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:18.205756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 146/278] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:18.210798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c95aaf-ef16-421f-8bd7-de7a14b10f17 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:18.245887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4c06b-5853-42fe-a570-a6fb5bad9435 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:18.292736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5565ea9-2073-448c-bf62-67410ff465d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:18.293935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5565ea9-2073-448c-bf62-67410ff465d9 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.294402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5565ea9-2073-448c-bf62-67410ff465d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.294863 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5565ea9-2073-448c-bf62-67410ff465d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.313186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c95aaf-ef16-421f-8bd7-de7a14b10f17 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:18.313394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5565ea9-2073-448c-bf62-67410ff465d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-d5565ea9-2073-448c-bf62-67410ff465d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:18.327704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:18.328707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:18.329521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:18.335394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 133/279] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:18.335394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5565ea9-2073-448c-bf62-67410ff465d9 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:18.358926 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb72dd-8b69-4e7f-bc25-476de24a3620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:18.359653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb72dd-8b69-4e7f-bc25-476de24a3620 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.359934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb72dd-8b69-4e7f-bc25-476de24a3620 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.360202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb72dd-8b69-4e7f-bc25-476de24a3620 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.360912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb72dd-8b69-4e7f-bc25-476de24a3620 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:18.362360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb72dd-8b69-4e7f-bc25-476de24a3620 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:18.386775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 147/280] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:17:18 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:17:18.388655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb72dd-8b69-4e7f-bc25-476de24a3620 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:18.470650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5565ea9-2073-448c-bf62-67410ff465d9 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:18.524735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef14869-798e-4950-b171-36ec644ffe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:18.525699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14869-798e-4950-b171-36ec644ffe45 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.525989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14869-798e-4950-b171-36ec644ffe45 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.526270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14869-798e-4950-b171-36ec644ffe45 None admin] PATH_INFO: `/v3/users/5b09c4f2f8de41a18dc4438dfbe4aefa` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.543537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef14869-798e-4950-b171-36ec644ffe45 None admin] RBAC: Authorizing `identity:get_user(user_id=5b09c4f2f8de41a18dc4438dfbe4aefa)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:18.543924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb72dd-8b69-4e7f-bc25-476de24a3620 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:18.545077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef14869-798e-4950-b171-36ec644ffe45 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:18.547526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 134/281] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:18 2022] GET /identity/v3/users/5b09c4f2f8de41a18dc4438dfbe4aefa => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:18.547526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89023104-ca6d-4274-9e2a-ad01da81da87 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.547526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89023104-ca6d-4274-9e2a-ad01da81da87 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.547526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89023104-ca6d-4274-9e2a-ad01da81da87 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.555207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 135/282] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:18.556442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89023104-ca6d-4274-9e2a-ad01da81da87 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:18.589429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec61b931-413c-4b9a-b168-0ef76674d60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:18.590110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61b931-413c-4b9a-b168-0ef76674d60b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.590274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61b931-413c-4b9a-b168-0ef76674d60b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.590551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec61b931-413c-4b9a-b168-0ef76674d60b None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.591353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61b931-413c-4b9a-b168-0ef76674d60b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:18.591710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61b931-413c-4b9a-b168-0ef76674d60b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:18.593675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec61b931-413c-4b9a-b168-0ef76674d60b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:18.602956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 148/283] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:18.604891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb8011-4375-40bc-8f2e-1261ca0516cd None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.605541 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb8011-4375-40bc-8f2e-1261ca0516cd None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.606071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb8011-4375-40bc-8f2e-1261ca0516cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.624747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-caeb8011-4375-40bc-8f2e-1261ca0516cd None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:18.626333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-caeb8011-4375-40bc-8f2e-1261ca0516cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:18.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89023104-ca6d-4274-9e2a-ad01da81da87 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:18.702087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 149/284] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:18.703343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb8011-4375-40bc-8f2e-1261ca0516cd None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:18.710202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de18b-8d70-4a83-a5a4-70979efd20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:18.711269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de18b-8d70-4a83-a5a4-70979efd20a0 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.711741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de18b-8d70-4a83-a5a4-70979efd20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.712188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4de18b-8d70-4a83-a5a4-70979efd20a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.713976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4de18b-8d70-4a83-a5a4-70979efd20a0 None admin] RBAC: Adding query filter params (role.id=2d441060f04441848c895dc5b9affb06, user.id=5b09c4f2f8de41a18dc4438dfbe4aefa, scope.system=all) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:18.713976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4de18b-8d70-4a83-a5a4-70979efd20a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:18.716334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4de18b-8d70-4a83-a5a4-70979efd20a0 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:18.723361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 136/285] 10.222.0.75 () {56 vars in 1308 bytes} [Thu May 12 14:17:18 2022] GET /identity/v3/role_assignments?user.id=5b09c4f2f8de41a18dc4438dfbe4aefa&scope.system=all&role.id=2d441060f04441848c895dc5b9affb06 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:18.742309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de18b-8d70-4a83-a5a4-70979efd20a0 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:18.864308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb8011-4375-40bc-8f2e-1261ca0516cd None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:18.892274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4de18b-8d70-4a83-a5a4-70979efd20a0 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:18.916009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef0f8a-9267-427a-b3d4-d06e618c3e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:18.917320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef0f8a-9267-427a-b3d4-d06e618c3e89 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.917609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef0f8a-9267-427a-b3d4-d06e618c3e89 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.917897 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef0f8a-9267-427a-b3d4-d06e618c3e89 None admin] PATH_INFO: `/v3/users/5e106f525a444eeb8aecb51f56c4bce6` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.919325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef0f8a-9267-427a-b3d4-d06e618c3e89 None admin] RBAC: Authorizing `identity:get_user(user_id=5e106f525a444eeb8aecb51f56c4bce6)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:18.921696 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef0f8a-9267-427a-b3d4-d06e618c3e89 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:18.923993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 150/286] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:18 2022] GET /identity/v3/users/5e106f525a444eeb8aecb51f56c4bce6 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:18.930819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef0f8a-9267-427a-b3d4-d06e618c3e89 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:18.941323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58339e03-1745-45d1-abad-937ed4a80279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:18.941323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339e03-1745-45d1-abad-937ed4a80279 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:18.941323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339e03-1745-45d1-abad-937ed4a80279 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:18.941323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58339e03-1745-45d1-abad-937ed4a80279 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:18.957438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58339e03-1745-45d1-abad-937ed4a80279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-58339e03-1745-45d1-abad-937ed4a80279 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:18.969129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:18.970309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:18.971285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:18.975167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 137/287] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:18.976696 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58339e03-1745-45d1-abad-937ed4a80279 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:19.066803 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef0f8a-9267-427a-b3d4-d06e618c3e89 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:19.096604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58339e03-1745-45d1-abad-937ed4a80279 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:19.114069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be862cfc-1e1a-4731-a16b-e86825b8c4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:19.114998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be862cfc-1e1a-4731-a16b-e86825b8c4f2 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:19.115253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be862cfc-1e1a-4731-a16b-e86825b8c4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:19.115528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be862cfc-1e1a-4731-a16b-e86825b8c4f2 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:19.116970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be862cfc-1e1a-4731-a16b-e86825b8c4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:19.118614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be862cfc-1e1a-4731-a16b-e86825b8c4f2 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:19.121060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 151/288] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:18 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:19.127459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be862cfc-1e1a-4731-a16b-e86825b8c4f2 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:19.143123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7075-f55d-4105-9c9c-7f59a5f70fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:19.144102 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7075-f55d-4105-9c9c-7f59a5f70fbd None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:19.144570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7075-f55d-4105-9c9c-7f59a5f70fbd None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:19.145052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca7075-f55d-4105-9c9c-7f59a5f70fbd None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:19.145993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca7075-f55d-4105-9c9c-7f59a5f70fbd None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:19.146784 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca7075-f55d-4105-9c9c-7f59a5f70fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:19.148469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca7075-f55d-4105-9c9c-7f59a5f70fbd None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:19.158083 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 138/289] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:19.172500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7075-f55d-4105-9c9c-7f59a5f70fbd None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:19.235517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be862cfc-1e1a-4731-a16b-e86825b8c4f2 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:19.273000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e369c-eebf-45aa-9e1a-bcfa2db277ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:19.273902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e369c-eebf-45aa-9e1a-bcfa2db277ff None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:19.274187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e369c-eebf-45aa-9e1a-bcfa2db277ff None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:19.274450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e369c-eebf-45aa-9e1a-bcfa2db277ff None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588/users/5e106f525a444eeb8aecb51f56c4bce6/roles/f22059c052f142f7b64fe5c629e314c6` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:19.276590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e369c-eebf-45aa-9e1a-bcfa2db277ff None admin] RBAC: Authorizing `identity:create_grant(project_id=4a5e849b81e744c08ab224f1f42af588, user_id=5e106f525a444eeb8aecb51f56c4bce6, role_id=f22059c052f142f7b64fe5c629e314c6)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:19.278123 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e369c-eebf-45aa-9e1a-bcfa2db277ff None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:19.303287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 152/290] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:17:19 2022] PUT /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588/users/5e106f525a444eeb8aecb51f56c4bce6/roles/f22059c052f142f7b64fe5c629e314c6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:17:19.320016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca7075-f55d-4105-9c9c-7f59a5f70fbd None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:19.361330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48102ae9-c8cb-41a2-83e2-f4dcc008ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:19.362562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48102ae9-c8cb-41a2-83e2-f4dcc008ea96 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:19.363096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48102ae9-c8cb-41a2-83e2-f4dcc008ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:19.363564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48102ae9-c8cb-41a2-83e2-f4dcc008ea96 None admin] PATH_INFO: `/v3/users/1673dfc6730b43beb31ca12415b442dd` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:19.365197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48102ae9-c8cb-41a2-83e2-f4dcc008ea96 None admin] RBAC: Authorizing `identity:get_user(user_id=1673dfc6730b43beb31ca12415b442dd)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:19.367327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48102ae9-c8cb-41a2-83e2-f4dcc008ea96 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:19.369685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 139/291] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:19 2022] GET /identity/v3/users/1673dfc6730b43beb31ca12415b442dd => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:19.378918 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e369c-eebf-45aa-9e1a-bcfa2db277ff None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:19.567384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e369c-eebf-45aa-9e1a-bcfa2db277ff None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:19.621799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea695-7007-4fbd-bb9d-bf3b6b750d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:19.622431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea695-7007-4fbd-bb9d-bf3b6b750d9b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:19.622664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea695-7007-4fbd-bb9d-bf3b6b750d9b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:19.622919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea695-7007-4fbd-bb9d-bf3b6b750d9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:19.712395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ea695-7007-4fbd-bb9d-bf3b6b750d9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:19.714001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ea695-7007-4fbd-bb9d-bf3b6b750d9b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:19.865966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 153/292] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:19.872188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48102ae9-c8cb-41a2-83e2-f4dcc008ea96 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:20.019885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48102ae9-c8cb-41a2-83e2-f4dcc008ea96 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:20.059668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b7269-32bd-4f0f-a959-ca34e208ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:20.060562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b7269-32bd-4f0f-a959-ca34e208ed1b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:20.060841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b7269-32bd-4f0f-a959-ca34e208ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:20.061115 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b7269-32bd-4f0f-a959-ca34e208ed1b None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:20.062452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b7269-32bd-4f0f-a959-ca34e208ed1b None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:20.064956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b7269-32bd-4f0f-a959-ca34e208ed1b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:20.067623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 140/293] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:19 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:20.073809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea695-7007-4fbd-bb9d-bf3b6b750d9b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:20.245089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea695-7007-4fbd-bb9d-bf3b6b750d9b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:20.309212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eef88-dc3a-43b4-af64-fdafae4dde33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:20.310333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eef88-dc3a-43b4-af64-fdafae4dde33 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:20.310636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eef88-dc3a-43b4-af64-fdafae4dde33 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:20.310917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eef88-dc3a-43b4-af64-fdafae4dde33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:20.312415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eef88-dc3a-43b4-af64-fdafae4dde33 None admin] RBAC: Adding query filter params (role.id=2d441060f04441848c895dc5b9affb06, scope.project.id=4a5e849b81e744c08ab224f1f42af588, user.id=1673dfc6730b43beb31ca12415b442dd) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:20.312734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eef88-dc3a-43b4-af64-fdafae4dde33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:20.314243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eef88-dc3a-43b4-af64-fdafae4dde33 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:20.325324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 154/294] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:20 2022] GET /identity/v3/role_assignments?user.id=1673dfc6730b43beb31ca12415b442dd&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=2d441060f04441848c895dc5b9affb06 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:21.391827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c71e34-43ee-43e2-8dcb-52fb5b920318 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:21.392882 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c71e34-43ee-43e2-8dcb-52fb5b920318 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:21.393387 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c71e34-43ee-43e2-8dcb-52fb5b920318 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:21.395276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 141/295] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:21.404345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857466-8d32-47e4-99bc-941d29a0367e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:21.405824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857466-8d32-47e4-99bc-941d29a0367e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:21.406566 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857466-8d32-47e4-99bc-941d29a0367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:21.436715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-db857466-8d32-47e4-99bc-941d29a0367e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:21.439348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-db857466-8d32-47e4-99bc-941d29a0367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:21.519231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e831f20-ece2-4ddf-8096-c3b3e8c32189 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:21.520631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e831f20-ece2-4ddf-8096-c3b3e8c32189 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:21.521925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e831f20-ece2-4ddf-8096-c3b3e8c32189 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:21.525703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 142/296] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:21.536142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed612e-c46e-455a-ae0a-004446801428 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:21.536783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed612e-c46e-455a-ae0a-004446801428 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:21.537293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed612e-c46e-455a-ae0a-004446801428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:21.553498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 155/297] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:21.554988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e9ed612e-c46e-455a-ae0a-004446801428 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:21.556467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e9ed612e-c46e-455a-ae0a-004446801428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:21.577719 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db857466-8d32-47e4-99bc-941d29a0367e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:21.628440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 143/298] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:21.652474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed612e-c46e-455a-ae0a-004446801428 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:21.710115 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db857466-8d32-47e4-99bc-941d29a0367e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:21.756250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051a62e-1f41-4ec5-8e79-5fac21ff03d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:21.757468 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051a62e-1f41-4ec5-8e79-5fac21ff03d7 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:21.757908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051a62e-1f41-4ec5-8e79-5fac21ff03d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:21.758523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051a62e-1f41-4ec5-8e79-5fac21ff03d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:21.774122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051a62e-1f41-4ec5-8e79-5fac21ff03d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-1051a62e-1f41-4ec5-8e79-5fac21ff03d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:21.782169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:21.783493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:21.784311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:21.787125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed612e-c46e-455a-ae0a-004446801428 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:21.788295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 156/299] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:21.789280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051a62e-1f41-4ec5-8e79-5fac21ff03d7 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:21.838768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18007-767b-4fa4-9ce0-87bcf66a343f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:21.840009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18007-767b-4fa4-9ce0-87bcf66a343f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:21.840505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18007-767b-4fa4-9ce0-87bcf66a343f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:21.840973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e18007-767b-4fa4-9ce0-87bcf66a343f None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:21.842540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e18007-767b-4fa4-9ce0-87bcf66a343f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:21.844387 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e18007-767b-4fa4-9ce0-87bcf66a343f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:21.851253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 144/300] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:21.853005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18007-767b-4fa4-9ce0-87bcf66a343f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:21.905199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051a62e-1f41-4ec5-8e79-5fac21ff03d7 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:21.939948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b9b6-ae25-409a-a33b-3778cce681de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:21.940634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b9b6-ae25-409a-a33b-3778cce681de None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:21.940921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b9b6-ae25-409a-a33b-3778cce681de None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:21.941202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b9b6-ae25-409a-a33b-3778cce681de None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:21.941963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b9b6-ae25-409a-a33b-3778cce681de None admin] RBAC: Adding query filter params (name=reader) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:21.942271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b9b6-ae25-409a-a33b-3778cce681de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:21.943716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b9b6-ae25-409a-a33b-3778cce681de None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:21.952360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 157/301] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:21.958465 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e18007-767b-4fa4-9ce0-87bcf66a343f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:21.969482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b9b6-ae25-409a-a33b-3778cce681de None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:22.020584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc20ab-7d86-49cc-9369-1190b9b92ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:22.021962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc20ab-7d86-49cc-9369-1190b9b92ce6 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.022451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc20ab-7d86-49cc-9369-1190b9b92ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.023019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc20ab-7d86-49cc-9369-1190b9b92ce6 None admin] PATH_INFO: `/v3/groups` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.023921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc20ab-7d86-49cc-9369-1190b9b92ce6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:22.025583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc20ab-7d86-49cc-9369-1190b9b92ce6 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:22.047222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 145/302] 10.222.0.75 () {60 vars in 1134 bytes} [Thu May 12 14:17:21 2022] POST /identity/v3/groups => generated 229 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:17:22.049899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80449f-7903-4c59-a0c8-92d6e5ece7fd None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.050554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80449f-7903-4c59-a0c8-92d6e5ece7fd None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.051316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80449f-7903-4c59-a0c8-92d6e5ece7fd None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.054515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 146/303] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:22.064433 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4534dc5-0e77-47c0-b3ec-93089de739fc None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.064881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4534dc5-0e77-47c0-b3ec-93089de739fc None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.065392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4534dc5-0e77-47c0-b3ec-93089de739fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.090949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c4534dc5-0e77-47c0-b3ec-93089de739fc None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:22.092264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c4534dc5-0e77-47c0-b3ec-93089de739fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:22.108701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b9b6-ae25-409a-a33b-3778cce681de None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:22.157309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32f1c-f7d2-4427-b655-36e03b67fccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:22.159220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32f1c-f7d2-4427-b655-36e03b67fccb None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.159992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32f1c-f7d2-4427-b655-36e03b67fccb None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.160445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b32f1c-f7d2-4427-b655-36e03b67fccb None admin] PATH_INFO: `/v3/users/f61276c9353f4ed5923ef6a31fa76229` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.171351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 147/304] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:22.175334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565f804-21f8-4592-a7d7-68b8dbed3bab None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.175334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565f804-21f8-4592-a7d7-68b8dbed3bab None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.175334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565f804-21f8-4592-a7d7-68b8dbed3bab None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.177339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 148/305] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:22.180928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b32f1c-f7d2-4427-b655-36e03b67fccb None admin] RBAC: Authorizing `identity:get_user(user_id=f61276c9353f4ed5923ef6a31fa76229)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:22.181977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d515a5e-2be3-4d31-b0da-18fafa2da194 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.182271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d515a5e-2be3-4d31-b0da-18fafa2da194 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.182493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b32f1c-f7d2-4427-b655-36e03b67fccb None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:22.182599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d515a5e-2be3-4d31-b0da-18fafa2da194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.184370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 158/306] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:21 2022] GET /identity/v3/users/f61276c9353f4ed5923ef6a31fa76229 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:22.190909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32f1c-f7d2-4427-b655-36e03b67fccb None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:22.200880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-7d515a5e-2be3-4d31-b0da-18fafa2da194 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:22.202831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7d515a5e-2be3-4d31-b0da-18fafa2da194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:22.285903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 149/307] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:22.286944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d515a5e-2be3-4d31-b0da-18fafa2da194 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:22.308456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b32f1c-f7d2-4427-b655-36e03b67fccb None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:22.351238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d2999-9cf0-44b6-95e9-6c056e214ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:22.352428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d2999-9cf0-44b6-95e9-6c056e214ac5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.353222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d2999-9cf0-44b6-95e9-6c056e214ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.353943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d2999-9cf0-44b6-95e9-6c056e214ac5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.354989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d2999-9cf0-44b6-95e9-6c056e214ac5 None admin] RBAC: Adding query filter params (role.id=f22059c052f142f7b64fe5c629e314c6, user.id=f61276c9353f4ed5923ef6a31fa76229, scope.system=all) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:22.355558 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d2999-9cf0-44b6-95e9-6c056e214ac5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:22.359276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d2999-9cf0-44b6-95e9-6c056e214ac5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:22.364849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 159/308] 10.222.0.75 () {56 vars in 1308 bytes} [Thu May 12 14:17:22 2022] GET /identity/v3/role_assignments?user.id=f61276c9353f4ed5923ef6a31fa76229&scope.system=all&role.id=f22059c052f142f7b64fe5c629e314c6 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:22.371389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d2999-9cf0-44b6-95e9-6c056e214ac5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:22.396940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d515a5e-2be3-4d31-b0da-18fafa2da194 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:22.435698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a8a6f-5fe4-48b1-b340-0a5d919d3560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:22.437286 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a8a6f-5fe4-48b1-b340-0a5d919d3560 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.437636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a8a6f-5fe4-48b1-b340-0a5d919d3560 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.437919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a8a6f-5fe4-48b1-b340-0a5d919d3560 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.450053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a8a6f-5fe4-48b1-b340-0a5d919d3560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-fe8a8a6f-5fe4-48b1-b340-0a5d919d3560 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:22.458222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:22.459460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:22.460459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:22.462773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 150/309] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:22.468339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a8a6f-5fe4-48b1-b340-0a5d919d3560 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:22.503248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d2999-9cf0-44b6-95e9-6c056e214ac5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:22.541298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393809e-2a80-4aff-b557-68891857a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:22.542113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393809e-2a80-4aff-b557-68891857a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.542587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393809e-2a80-4aff-b557-68891857a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.543014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393809e-2a80-4aff-b557-68891857a3d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.555562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393809e-2a80-4aff-b557-68891857a3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-f393809e-2a80-4aff-b557-68891857a3d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:22.564084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:22.565207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:22.565994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:22.568033 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 160/310] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:22.575063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393809e-2a80-4aff-b557-68891857a3d9 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:22.591765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a8a6f-5fe4-48b1-b340-0a5d919d3560 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:22.634072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822227-b3b2-47a5-b568-5d326f02e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:22.635831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822227-b3b2-47a5-b568-5d326f02e545 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.636303 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822227-b3b2-47a5-b568-5d326f02e545 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.636625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b822227-b3b2-47a5-b568-5d326f02e545 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.637410 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822227-b3b2-47a5-b568-5d326f02e545 None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:22.637726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822227-b3b2-47a5-b568-5d326f02e545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:22.640568 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b822227-b3b2-47a5-b568-5d326f02e545 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:22.652598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 151/311] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:22.658654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822227-b3b2-47a5-b568-5d326f02e545 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:22.712378 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393809e-2a80-4aff-b557-68891857a3d9 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:22.754658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58d3bf-e2f7-4e2d-9c9c-372087864fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:22.755729 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d3bf-e2f7-4e2d-9c9c-372087864fe1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.756241 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d3bf-e2f7-4e2d-9c9c-372087864fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.756730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d3bf-e2f7-4e2d-9c9c-372087864fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.757683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58d3bf-e2f7-4e2d-9c9c-372087864fe1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:22.758199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58d3bf-e2f7-4e2d-9c9c-372087864fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:22.759887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58d3bf-e2f7-4e2d-9c9c-372087864fe1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:22.769258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 161/312] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:22.774846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58d3bf-e2f7-4e2d-9c9c-372087864fe1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:22.780496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b822227-b3b2-47a5-b568-5d326f02e545 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:22.817893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3b70f-da0f-48f9-bef2-192c8bdd3f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:22.819723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3b70f-da0f-48f9-bef2-192c8bdd3f7b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.820396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3b70f-da0f-48f9-bef2-192c8bdd3f7b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.821159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3b70f-da0f-48f9-bef2-192c8bdd3f7b None admin] PATH_INFO: `/v3/users/5b09c4f2f8de41a18dc4438dfbe4aefa` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.824010 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3b70f-da0f-48f9-bef2-192c8bdd3f7b None admin] RBAC: Authorizing `identity:get_user(user_id=5b09c4f2f8de41a18dc4438dfbe4aefa)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:22.828065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3b70f-da0f-48f9-bef2-192c8bdd3f7b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:22.839427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 152/313] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:22 2022] GET /identity/v3/users/5b09c4f2f8de41a18dc4438dfbe4aefa => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:22.841409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3b70f-da0f-48f9-bef2-192c8bdd3f7b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:22.890889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58d3bf-e2f7-4e2d-9c9c-372087864fe1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:22.929966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecf169-d840-42c1-b41e-219b8d38bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:22.932682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecf169-d840-42c1-b41e-219b8d38bf94 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:22.933401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecf169-d840-42c1-b41e-219b8d38bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:22.934331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecf169-d840-42c1-b41e-219b8d38bf94 None admin] PATH_INFO: `/v3/users/5e106f525a444eeb8aecb51f56c4bce6` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:22.939457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecf169-d840-42c1-b41e-219b8d38bf94 None admin] RBAC: Authorizing `identity:get_user(user_id=5e106f525a444eeb8aecb51f56c4bce6)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:22.948959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecf169-d840-42c1-b41e-219b8d38bf94 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:22.954314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 162/314] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:22 2022] GET /identity/v3/users/5e106f525a444eeb8aecb51f56c4bce6 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:22.960457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecf169-d840-42c1-b41e-219b8d38bf94 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:22.982706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3b70f-da0f-48f9-bef2-192c8bdd3f7b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:23.024901 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f234f8-6c31-42d8-93da-4154da382756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:23.026585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f234f8-6c31-42d8-93da-4154da382756 None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:23.027268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f234f8-6c31-42d8-93da-4154da382756 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:23.027829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f234f8-6c31-42d8-93da-4154da382756 None admin] PATH_INFO: `/v3/system/users/5b09c4f2f8de41a18dc4438dfbe4aefa/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:23.030596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f234f8-6c31-42d8-93da-4154da382756 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5b09c4f2f8de41a18dc4438dfbe4aefa, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:23.032665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f234f8-6c31-42d8-93da-4154da382756 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:23.055149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 153/315] 10.222.0.75 () {58 vars in 1334 bytes} [Thu May 12 14:17:22 2022] PUT /identity/v3/system/users/5b09c4f2f8de41a18dc4438dfbe4aefa/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:17:23.086383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecf169-d840-42c1-b41e-219b8d38bf94 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:23.130253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1c05a-88b9-4014-84ae-d13a3454a8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:23.131261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c05a-88b9-4014-84ae-d13a3454a8f7 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:23.131754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c05a-88b9-4014-84ae-d13a3454a8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:23.132210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c05a-88b9-4014-84ae-d13a3454a8f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:23.210750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1c05a-88b9-4014-84ae-d13a3454a8f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:23.212596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1c05a-88b9-4014-84ae-d13a3454a8f7 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:23.330599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 163/316] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:17:23.336624 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f234f8-6c31-42d8-93da-4154da382756 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:23.471664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f234f8-6c31-42d8-93da-4154da382756 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:23.531422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29607236-46f9-4112-8fa4-68e6bab19996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:23.532923 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29607236-46f9-4112-8fa4-68e6bab19996 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:23.533419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29607236-46f9-4112-8fa4-68e6bab19996 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:23.533907 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29607236-46f9-4112-8fa4-68e6bab19996 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:23.536051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29607236-46f9-4112-8fa4-68e6bab19996 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:23.538795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29607236-46f9-4112-8fa4-68e6bab19996 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:23.542027 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 154/317] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:23 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:23.551645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1c05a-88b9-4014-84ae-d13a3454a8f7 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:23.684430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1c05a-88b9-4014-84ae-d13a3454a8f7 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:23.721163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5da27-5ca9-4794-bb61-81bb2a5e65b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:23.722223 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5da27-5ca9-4794-bb61-81bb2a5e65b0 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:23.722726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5da27-5ca9-4794-bb61-81bb2a5e65b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:23.723233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5da27-5ca9-4794-bb61-81bb2a5e65b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:23.724275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5da27-5ca9-4794-bb61-81bb2a5e65b0 None admin] RBAC: Adding query filter params (role.id=f22059c052f142f7b64fe5c629e314c6, scope.project.id=4a5e849b81e744c08ab224f1f42af588, user.id=5e106f525a444eeb8aecb51f56c4bce6) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:23.724801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5da27-5ca9-4794-bb61-81bb2a5e65b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:23.726476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5da27-5ca9-4794-bb61-81bb2a5e65b0 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:23.734201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 164/318] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:23 2022] GET /identity/v3/role_assignments?user.id=5e106f525a444eeb8aecb51f56c4bce6&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=f22059c052f142f7b64fe5c629e314c6 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:24.433276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998711b3-2ba6-4e2c-87f4-bee9b5b3b50e None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:24.437379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998711b3-2ba6-4e2c-87f4-bee9b5b3b50e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:24.437379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998711b3-2ba6-4e2c-87f4-bee9b5b3b50e None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:24.437379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 155/319] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:24.441116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc7ffe-99d5-49e2-ac96-fad26dc83ffc None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:24.441405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc7ffe-99d5-49e2-ac96-fad26dc83ffc None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:24.441679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc7ffe-99d5-49e2-ac96-fad26dc83ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:24.458430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2ccc7ffe-99d5-49e2-ac96-fad26dc83ffc None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:24.459656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2ccc7ffe-99d5-49e2-ac96-fad26dc83ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:24.528208 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 165/320] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:24.552282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998711b3-2ba6-4e2c-87f4-bee9b5b3b50e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:24.652150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998711b3-2ba6-4e2c-87f4-bee9b5b3b50e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:24.688978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bb402-b718-4c59-9cf3-72f82420c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:24.689698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bb402-b718-4c59-9cf3-72f82420c0ec None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:24.689976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bb402-b718-4c59-9cf3-72f82420c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:24.690245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bb402-b718-4c59-9cf3-72f82420c0ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:24.691481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bb402-b718-4c59-9cf3-72f82420c0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:24.692960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bb402-b718-4c59-9cf3-72f82420c0ec None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:24.694854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 156/321] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:24.700760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc7ffe-99d5-49e2-ac96-fad26dc83ffc None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:24.800818 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc7ffe-99d5-49e2-ac96-fad26dc83ffc None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:24.836883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13014588-3781-43f4-a36f-b3ad62ce048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:24.837561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014588-3781-43f4-a36f-b3ad62ce048d None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:24.838042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014588-3781-43f4-a36f-b3ad62ce048d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:24.838475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13014588-3781-43f4-a36f-b3ad62ce048d None admin] PATH_INFO: `/v3/groups` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:24.839447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13014588-3781-43f4-a36f-b3ad62ce048d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:24.841118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13014588-3781-43f4-a36f-b3ad62ce048d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:24.859228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 166/322] 10.222.0.75 () {60 vars in 1134 bytes} [Thu May 12 14:17:24 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:17:24.908607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a929-3f1a-42cc-ae15-939f59d9037a None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:24.908959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a929-3f1a-42cc-ae15-939f59d9037a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:24.909168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a929-3f1a-42cc-ae15-939f59d9037a None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:24.910739 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 157/323] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:24.916311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c92cb7-5ab2-411d-8d31-d57d116a01ae None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:24.916637 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c92cb7-5ab2-411d-8d31-d57d116a01ae None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:24.916884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c92cb7-5ab2-411d-8d31-d57d116a01ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:24.937046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-e7c92cb7-5ab2-411d-8d31-d57d116a01ae None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:24.939122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e7c92cb7-5ab2-411d-8d31-d57d116a01ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:25.015093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 167/324] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:25.037643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2a929-3f1a-42cc-ae15-939f59d9037a None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:25.148058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2a929-3f1a-42cc-ae15-939f59d9037a None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:25.193208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10230e86-2e01-49a6-bb2e-0ac0eddb4859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:25.194509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10230e86-2e01-49a6-bb2e-0ac0eddb4859 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:25.195001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10230e86-2e01-49a6-bb2e-0ac0eddb4859 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:25.195594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10230e86-2e01-49a6-bb2e-0ac0eddb4859 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:25.225001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10230e86-2e01-49a6-bb2e-0ac0eddb4859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-10230e86-2e01-49a6-bb2e-0ac0eddb4859 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:25.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:25.237650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:25.239336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:25.242261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 158/325] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:25.244305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c92cb7-5ab2-411d-8d31-d57d116a01ae None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:25.388709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c92cb7-5ab2-411d-8d31-d57d116a01ae None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:25.416081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5007a58-05f1-4b0e-8488-1df98666f7a2 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:25.416390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5007a58-05f1-4b0e-8488-1df98666f7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:25.416642 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5007a58-05f1-4b0e-8488-1df98666f7a2 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:25.418228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 159/326] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:25.424968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddc338-be7f-40c8-b678-b378fd31876a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:25.425250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddc338-be7f-40c8-b678-b378fd31876a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:25.425528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddc338-be7f-40c8-b678-b378fd31876a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:25.429023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a2a20-db2e-46f3-93b0-8c3eac1cbfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:25.429702 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a2a20-db2e-46f3-93b0-8c3eac1cbfd3 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:25.429983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a2a20-db2e-46f3-93b0-8c3eac1cbfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:25.430252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a2a20-db2e-46f3-93b0-8c3eac1cbfd3 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:25.431010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a2a20-db2e-46f3-93b0-8c3eac1cbfd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:25.431345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a2a20-db2e-46f3-93b0-8c3eac1cbfd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:25.433422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a2a20-db2e-46f3-93b0-8c3eac1cbfd3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:25.442319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 168/327] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:25.444923 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-96ddc338-be7f-40c8-b678-b378fd31876a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:25.447080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-96ddc338-be7f-40c8-b678-b378fd31876a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:25.448143 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a2a20-db2e-46f3-93b0-8c3eac1cbfd3 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:25.518918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 160/328] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:25.543202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddc338-be7f-40c8-b678-b378fd31876a None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:25.559528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a2a20-db2e-46f3-93b0-8c3eac1cbfd3 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:25.607121 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6d2b-765a-4e3f-915d-add37e5d5893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:25.608077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6d2b-765a-4e3f-915d-add37e5d5893 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:25.608368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6d2b-765a-4e3f-915d-add37e5d5893 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:25.608643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6d2b-765a-4e3f-915d-add37e5d5893 None admin] PATH_INFO: `/v3/users/f61276c9353f4ed5923ef6a31fa76229` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:25.609894 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6d2b-765a-4e3f-915d-add37e5d5893 None admin] RBAC: Authorizing `identity:get_user(user_id=f61276c9353f4ed5923ef6a31fa76229)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:25.611382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6d2b-765a-4e3f-915d-add37e5d5893 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:25.617753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 169/329] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:25 2022] GET /identity/v3/users/f61276c9353f4ed5923ef6a31fa76229 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:25.619103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6d2b-765a-4e3f-915d-add37e5d5893 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:25.704736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddc338-be7f-40c8-b678-b378fd31876a None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:25.749250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19444ba2-3ba7-4f38-98a9-09027f7da651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:25.750070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444ba2-3ba7-4f38-98a9-09027f7da651 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:25.750355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444ba2-3ba7-4f38-98a9-09027f7da651 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:25.750631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19444ba2-3ba7-4f38-98a9-09027f7da651 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:25.761831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19444ba2-3ba7-4f38-98a9-09027f7da651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:25.768218 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6d2b-765a-4e3f-915d-add37e5d5893 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-19444ba2-3ba7-4f38-98a9-09027f7da651 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:25.770750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:25.771946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:25.772764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:25.774916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 161/330] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:25.780473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19444ba2-3ba7-4f38-98a9-09027f7da651 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:25.807590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9f08d-63f2-41e6-8af5-396f934fed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:25.808814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9f08d-63f2-41e6-8af5-396f934fed3e None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:25.809418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9f08d-63f2-41e6-8af5-396f934fed3e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:25.809913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9f08d-63f2-41e6-8af5-396f934fed3e None admin] PATH_INFO: `/v3/system/users/f61276c9353f4ed5923ef6a31fa76229/roles/f22059c052f142f7b64fe5c629e314c6` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:25.812231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9f08d-63f2-41e6-8af5-396f934fed3e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f61276c9353f4ed5923ef6a31fa76229, role_id=f22059c052f142f7b64fe5c629e314c6)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:25.813847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a9f08d-63f2-41e6-8af5-396f934fed3e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:25.828045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 170/331] 10.222.0.75 () {58 vars in 1334 bytes} [Thu May 12 14:17:25 2022] PUT /identity/v3/system/users/f61276c9353f4ed5923ef6a31fa76229/roles/f22059c052f142f7b64fe5c629e314c6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:17:25.938151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19444ba2-3ba7-4f38-98a9-09027f7da651 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:25.982911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fa776-1059-4c65-b04c-3316b4b8be15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:25.984170 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fa776-1059-4c65-b04c-3316b4b8be15 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:25.984456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fa776-1059-4c65-b04c-3316b4b8be15 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:25.984733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fa776-1059-4c65-b04c-3316b4b8be15 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:25.985492 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fa776-1059-4c65-b04c-3316b4b8be15 None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:25.985803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fa776-1059-4c65-b04c-3316b4b8be15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:25.987220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fa776-1059-4c65-b04c-3316b4b8be15 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:26.001233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 162/332] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:26.002778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9f08d-63f2-41e6-8af5-396f934fed3e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:26.164580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9f08d-63f2-41e6-8af5-396f934fed3e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:26.202375 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ee6d2-f240-40c9-9052-4234b2b31b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:26.203295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ee6d2-f240-40c9-9052-4234b2b31b0e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:26.203580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ee6d2-f240-40c9-9052-4234b2b31b0e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:26.203858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ee6d2-f240-40c9-9052-4234b2b31b0e None admin] PATH_INFO: `/v3/users/5b09c4f2f8de41a18dc4438dfbe4aefa` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:26.205119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ee6d2-f240-40c9-9052-4234b2b31b0e None admin] RBAC: Authorizing `identity:get_user(user_id=5b09c4f2f8de41a18dc4438dfbe4aefa)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:26.206582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ee6d2-f240-40c9-9052-4234b2b31b0e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:26.208680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 171/333] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:26 2022] GET /identity/v3/users/5b09c4f2f8de41a18dc4438dfbe4aefa => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:26.214175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fa776-1059-4c65-b04c-3316b4b8be15 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:26.327592 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fa776-1059-4c65-b04c-3316b4b8be15 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:26.363360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf6e6a-3f0e-4feb-a420-7cdb0dd7a789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:26.364034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf6e6a-3f0e-4feb-a420-7cdb0dd7a789 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:26.364319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf6e6a-3f0e-4feb-a420-7cdb0dd7a789 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:26.364597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf6e6a-3f0e-4feb-a420-7cdb0dd7a789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:26.365455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf6e6a-3f0e-4feb-a420-7cdb0dd7a789 None admin] RBAC: Adding query filter params (role.id=2d441060f04441848c895dc5b9affb06, user.id=5b09c4f2f8de41a18dc4438dfbe4aefa, scope.system=all) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:26.365799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf6e6a-3f0e-4feb-a420-7cdb0dd7a789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:26.367313 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf6e6a-3f0e-4feb-a420-7cdb0dd7a789 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:26.380957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 163/334] 10.222.0.75 () {56 vars in 1308 bytes} [Thu May 12 14:17:26 2022] GET /identity/v3/role_assignments?user.id=5b09c4f2f8de41a18dc4438dfbe4aefa&scope.system=all&role.id=2d441060f04441848c895dc5b9affb06 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:28.018287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409ab2-19b2-49d0-ac48-a9fb6bf7ec86 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:28.018817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409ab2-19b2-49d0-ac48-a9fb6bf7ec86 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:28.019108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409ab2-19b2-49d0-ac48-a9fb6bf7ec86 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:28.020810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 172/335] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:28.037204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767865-33ff-48ba-a32c-8ad5a6636d12 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:28.038180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767865-33ff-48ba-a32c-8ad5a6636d12 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:28.038666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767865-33ff-48ba-a32c-8ad5a6636d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:28.060913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-94767865-33ff-48ba-a32c-8ad5a6636d12 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:28.063011 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-94767865-33ff-48ba-a32c-8ad5a6636d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:28.153468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 164/336] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:28.196525 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05409ab2-19b2-49d0-ac48-a9fb6bf7ec86 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:28.223866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238fb49-c47a-4439-bc32-65e21f6d3b32 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:28.223866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238fb49-c47a-4439-bc32-65e21f6d3b32 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:28.223866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238fb49-c47a-4439-bc32-65e21f6d3b32 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:28.224478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 165/337] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:28.231633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900268d-d1dd-41cc-a0c5-a85616f2347c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:28.232195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900268d-d1dd-41cc-a0c5-a85616f2347c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:28.232666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900268d-d1dd-41cc-a0c5-a85616f2347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:28.253820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d900268d-d1dd-41cc-a0c5-a85616f2347c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:28.255369 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d900268d-d1dd-41cc-a0c5-a85616f2347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:28.386285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05409ab2-19b2-49d0-ac48-a9fb6bf7ec86 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:28.409288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 166/338] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:28.444733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcc8a0-1f85-4d0c-a5af-920dbad06c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:28.445943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcc8a0-1f85-4d0c-a5af-920dbad06c35 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:28.446461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcc8a0-1f85-4d0c-a5af-920dbad06c35 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:28.446927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcc8a0-1f85-4d0c-a5af-920dbad06c35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:28.459172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedcc8a0-1f85-4d0c-a5af-920dbad06c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-bedcc8a0-1f85-4d0c-a5af-920dbad06c35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:28.467607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:28.468570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:28.469368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:28.471978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 173/339] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:28.477869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900268d-d1dd-41cc-a0c5-a85616f2347c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:28.488526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcc8a0-1f85-4d0c-a5af-920dbad06c35 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:28.642686 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcc8a0-1f85-4d0c-a5af-920dbad06c35 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:28.682328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea33604-0c47-4f1a-8513-cbf18f9370b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:28.683487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea33604-0c47-4f1a-8513-cbf18f9370b1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:28.683922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea33604-0c47-4f1a-8513-cbf18f9370b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:28.684349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea33604-0c47-4f1a-8513-cbf18f9370b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:28.691285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900268d-d1dd-41cc-a0c5-a85616f2347c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:28.696700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea33604-0c47-4f1a-8513-cbf18f9370b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-cea33604-0c47-4f1a-8513-cbf18f9370b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:28.705923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:28.707111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:28.708131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:28.710667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 174/340] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:28.719432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea33604-0c47-4f1a-8513-cbf18f9370b1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:28.773252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8c57-ad9c-480b-8c6f-d615d94207b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:28.773874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8c57-ad9c-480b-8c6f-d615d94207b1 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:28.774157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8c57-ad9c-480b-8c6f-d615d94207b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:28.774433 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8c57-ad9c-480b-8c6f-d615d94207b1 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:28.775242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8c57-ad9c-480b-8c6f-d615d94207b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:28.775558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8c57-ad9c-480b-8c6f-d615d94207b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:28.777019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8c57-ad9c-480b-8c6f-d615d94207b1 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:28.795015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 167/341] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:28.800876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8c57-ad9c-480b-8c6f-d615d94207b1 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:28.905868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea33604-0c47-4f1a-8513-cbf18f9370b1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:28.945701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708495a-9c3a-4255-bd2d-7bdf060f7789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:28.946779 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708495a-9c3a-4255-bd2d-7bdf060f7789 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:28.947281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708495a-9c3a-4255-bd2d-7bdf060f7789 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:28.947767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708495a-9c3a-4255-bd2d-7bdf060f7789 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:28.948716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708495a-9c3a-4255-bd2d-7bdf060f7789 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:28.949215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708495a-9c3a-4255-bd2d-7bdf060f7789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:28.950827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708495a-9c3a-4255-bd2d-7bdf060f7789 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:28.965014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 175/342] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:28.966458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8c57-ad9c-480b-8c6f-d615d94207b1 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:28.973549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708495a-9c3a-4255-bd2d-7bdf060f7789 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:29.019850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605ffb7-8dff-46cc-a68a-2770b454a90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:29.020822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ffb7-8dff-46cc-a68a-2770b454a90e None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.021263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ffb7-8dff-46cc-a68a-2770b454a90e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.021939 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605ffb7-8dff-46cc-a68a-2770b454a90e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:29.094213 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708495a-9c3a-4255-bd2d-7bdf060f7789 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:29.125896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ffb7-8dff-46cc-a68a-2770b454a90e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:29.127516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605ffb7-8dff-46cc-a68a-2770b454a90e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:29.140704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30314946-37ec-4551-842f-ccc906b4028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:29.141752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30314946-37ec-4551-842f-ccc906b4028b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.142228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30314946-37ec-4551-842f-ccc906b4028b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.142729 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30314946-37ec-4551-842f-ccc906b4028b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:29.263386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30314946-37ec-4551-842f-ccc906b4028b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:29.265282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30314946-37ec-4551-842f-ccc906b4028b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:29.306689 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 168/343] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:29.313032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447429b-b9a1-4225-9e62-fb4ac4c8dde6 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.313690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447429b-b9a1-4225-9e62-fb4ac4c8dde6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.314139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447429b-b9a1-4225-9e62-fb4ac4c8dde6 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:29.316016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 169/344] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:29.316921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447429b-b9a1-4225-9e62-fb4ac4c8dde6 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:29.385464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 176/345] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:17:29.386701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8380a9-9d16-4e95-9b1d-83074afcd466 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.387193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8380a9-9d16-4e95-9b1d-83074afcd466 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.387611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8380a9-9d16-4e95-9b1d-83074afcd466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:29.408938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-de8380a9-9d16-4e95-9b1d-83074afcd466 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:29.410391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-de8380a9-9d16-4e95-9b1d-83074afcd466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:29.471820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447429b-b9a1-4225-9e62-fb4ac4c8dde6 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:29.483723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 177/346] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:29.485283 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d99a-dcc7-4632-8a79-6f7e0ee051b0 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.485714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d99a-dcc7-4632-8a79-6f7e0ee051b0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.486127 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d99a-dcc7-4632-8a79-6f7e0ee051b0 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:29.487599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 178/347] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:29.488449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d99a-dcc7-4632-8a79-6f7e0ee051b0 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:29.518958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976b335-8078-45d7-bc23-fc782d76c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:29.519910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976b335-8078-45d7-bc23-fc782d76c621 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.520197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976b335-8078-45d7-bc23-fc782d76c621 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.520469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976b335-8078-45d7-bc23-fc782d76c621 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:29.522297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976b335-8078-45d7-bc23-fc782d76c621 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:29.524532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976b335-8078-45d7-bc23-fc782d76c621 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:29.526914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 170/348] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:29 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:29.528429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895f5b-049c-4372-bd02-aa2a9a91471e None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.529115 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895f5b-049c-4372-bd02-aa2a9a91471e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.529390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03895f5b-049c-4372-bd02-aa2a9a91471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:29.550355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-03895f5b-049c-4372-bd02-aa2a9a91471e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:29.551771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-03895f5b-049c-4372-bd02-aa2a9a91471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:29.621517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d99a-dcc7-4632-8a79-6f7e0ee051b0 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:29.636030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 171/349] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:29.637240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03895f5b-049c-4372-bd02-aa2a9a91471e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:29.675207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a73bd-616f-41f0-ac6f-bfb4f0a93174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:29.676310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a73bd-616f-41f0-ac6f-bfb4f0a93174 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.677171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a73bd-616f-41f0-ac6f-bfb4f0a93174 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.677668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a73bd-616f-41f0-ac6f-bfb4f0a93174 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:29.679139 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a73bd-616f-41f0-ac6f-bfb4f0a93174 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:29.681411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a73bd-616f-41f0-ac6f-bfb4f0a93174 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:29.683926 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 179/350] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:29 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:29.685290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a73bd-616f-41f0-ac6f-bfb4f0a93174 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:29.772784 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03895f5b-049c-4372-bd02-aa2a9a91471e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:29.806961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a73bd-616f-41f0-ac6f-bfb4f0a93174 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:29.807434 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b643e51-2468-4b29-b0cf-ee1c06910652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:29.808490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b643e51-2468-4b29-b0cf-ee1c06910652 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.808962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b643e51-2468-4b29-b0cf-ee1c06910652 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.809433 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b643e51-2468-4b29-b0cf-ee1c06910652 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:29.824437 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b643e51-2468-4b29-b0cf-ee1c06910652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-9b643e51-2468-4b29-b0cf-ee1c06910652 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:29.836151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:29.837125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 12 14:17:29.837950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:29.840890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 172/351] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:29.841830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b643e51-2468-4b29-b0cf-ee1c06910652 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:29.849897 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585acebb-e0f2-4d6d-9b11-ddbcadb29f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:29.851161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585acebb-e0f2-4d6d-9b11-ddbcadb29f83 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.851678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585acebb-e0f2-4d6d-9b11-ddbcadb29f83 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.852819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585acebb-e0f2-4d6d-9b11-ddbcadb29f83 None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:29.864240 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585acebb-e0f2-4d6d-9b11-ddbcadb29f83 None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:29.866568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585acebb-e0f2-4d6d-9b11-ddbcadb29f83 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:29.868925 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 180/352] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:29 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:29.869987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585acebb-e0f2-4d6d-9b11-ddbcadb29f83 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:29.962201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b643e51-2468-4b29-b0cf-ee1c06910652 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:29.990793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585acebb-e0f2-4d6d-9b11-ddbcadb29f83 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:29.997384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185dfec-11e8-4e6b-b533-2e9f975baaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:29.998397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185dfec-11e8-4e6b-b533-2e9f975baaea None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:29.998675 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185dfec-11e8-4e6b-b533-2e9f975baaea None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:29.998950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185dfec-11e8-4e6b-b533-2e9f975baaea None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.000396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185dfec-11e8-4e6b-b533-2e9f975baaea None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:30.001948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185dfec-11e8-4e6b-b533-2e9f975baaea None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:30.004060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 173/353] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:29 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:30.005090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185dfec-11e8-4e6b-b533-2e9f975baaea None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:30.062529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4eedf-32bd-4865-9430-86c5d2eb67dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:30.063894 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4eedf-32bd-4865-9430-86c5d2eb67dc None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.063894 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4eedf-32bd-4865-9430-86c5d2eb67dc None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.064090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4eedf-32bd-4865-9430-86c5d2eb67dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.078016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce4eedf-32bd-4865-9430-86c5d2eb67dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-3ce4eedf-32bd-4865-9430-86c5d2eb67dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:30.085808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:30.087352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:30.088154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 181/354] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:30.088814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4eedf-32bd-4865-9430-86c5d2eb67dc None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:30.142009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185dfec-11e8-4e6b-b533-2e9f975baaea None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:30.180482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89116-949e-4cb6-8b7f-2bc29e53d73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:30.181164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89116-949e-4cb6-8b7f-2bc29e53d73b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.181447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89116-949e-4cb6-8b7f-2bc29e53d73b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.181717 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b89116-949e-4cb6-8b7f-2bc29e53d73b None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.182486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89116-949e-4cb6-8b7f-2bc29e53d73b None admin] RBAC: Adding query filter params (name=reader) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:30.182794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89116-949e-4cb6-8b7f-2bc29e53d73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:30.184238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b89116-949e-4cb6-8b7f-2bc29e53d73b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:30.194061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 174/355] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:30.194910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89116-949e-4cb6-8b7f-2bc29e53d73b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:30.205680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4eedf-32bd-4865-9430-86c5d2eb67dc None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:30.256483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da0517-5bec-4a31-aaca-d96f8b4f52d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:30.257074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da0517-5bec-4a31-aaca-d96f8b4f52d7 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.257355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da0517-5bec-4a31-aaca-d96f8b4f52d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.257630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da0517-5bec-4a31-aaca-d96f8b4f52d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.258511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da0517-5bec-4a31-aaca-d96f8b4f52d7 None admin] RBAC: Adding query filter params (group.id=21011426bf0e4cbd9ab8a1f49c712b87, role.id=2d441060f04441848c895dc5b9affb06, scope.project.id=540bf727f064487c930910ee34bc6da0) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:30.259220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da0517-5bec-4a31-aaca-d96f8b4f52d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:30.260380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da0517-5bec-4a31-aaca-d96f8b4f52d7 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:30.267952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 182/356] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 12 14:17:30 2022] GET /identity/v3/role_assignments?group.id=21011426bf0e4cbd9ab8a1f49c712b87&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=2d441060f04441848c895dc5b9affb06 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:30.269372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd288e-a6ff-4403-b0f5-3c140f29177e None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.269658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd288e-a6ff-4403-b0f5-3c140f29177e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.269931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd288e-a6ff-4403-b0f5-3c140f29177e None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.271976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 183/357] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:30.272757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd288e-a6ff-4403-b0f5-3c140f29177e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:30.345550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b89116-949e-4cb6-8b7f-2bc29e53d73b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:30.410869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3d941-a4f9-4a3d-ad0e-366491deffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:30.412012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3d941-a4f9-4a3d-ad0e-366491deffcf None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.412496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3d941-a4f9-4a3d-ad0e-366491deffcf None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.412961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3d941-a4f9-4a3d-ad0e-366491deffcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.414542 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3d941-a4f9-4a3d-ad0e-366491deffcf None admin] RBAC: Adding query filter params (group.id=21011426bf0e4cbd9ab8a1f49c712b87, role.id=8b437ce0fad84637a68c6c151d4e2c5c, scope.project.id=540bf727f064487c930910ee34bc6da0) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:30.415061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3d941-a4f9-4a3d-ad0e-366491deffcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:30.417804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3d941-a4f9-4a3d-ad0e-366491deffcf None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:30.423489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd288e-a6ff-4403-b0f5-3c140f29177e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:30.436970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 175/358] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 12 14:17:30 2022] GET /identity/v3/role_assignments?group.id=21011426bf0e4cbd9ab8a1f49c712b87&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=8b437ce0fad84637a68c6c151d4e2c5c => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:30.436970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3d941-a4f9-4a3d-ad0e-366491deffcf None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:30.483903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f93e5-2d18-46fb-b6d3-f4e0b905f831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:30.485254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f93e5-2d18-46fb-b6d3-f4e0b905f831 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.485890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f93e5-2d18-46fb-b6d3-f4e0b905f831 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.486390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f93e5-2d18-46fb-b6d3-f4e0b905f831 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.487848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f93e5-2d18-46fb-b6d3-f4e0b905f831 None admin] RBAC: Adding query filter params (name=member) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:30.488482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f93e5-2d18-46fb-b6d3-f4e0b905f831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:30.490091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f93e5-2d18-46fb-b6d3-f4e0b905f831 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:30.505875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 184/359] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:30.511156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead06c6-24c6-4015-b0f7-523490e70a9a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.511962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead06c6-24c6-4015-b0f7-523490e70a9a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.512428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead06c6-24c6-4015-b0f7-523490e70a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.532644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-1ead06c6-24c6-4015-b0f7-523490e70a9a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:30.534136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1ead06c6-24c6-4015-b0f7-523490e70a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:30.585700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3d941-a4f9-4a3d-ad0e-366491deffcf None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:30.631969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275150d-fe8e-4ac2-952e-a8719dae4ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:30.633189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275150d-fe8e-4ac2-952e-a8719dae4ea4 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.633994 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275150d-fe8e-4ac2-952e-a8719dae4ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.634361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275150d-fe8e-4ac2-952e-a8719dae4ea4 None admin] PATH_INFO: `/v3/users/f61276c9353f4ed5923ef6a31fa76229` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.636069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275150d-fe8e-4ac2-952e-a8719dae4ea4 None admin] RBAC: Authorizing `identity:get_user(user_id=f61276c9353f4ed5923ef6a31fa76229)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:30.638277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275150d-fe8e-4ac2-952e-a8719dae4ea4 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:30.641420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 176/360] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:17:30 2022] GET /identity/v3/users/f61276c9353f4ed5923ef6a31fa76229 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:30.643009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c80d9-07ec-45c2-92e2-4b30e94f4e80 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.643401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c80d9-07ec-45c2-92e2-4b30e94f4e80 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.643753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c80d9-07ec-45c2-92e2-4b30e94f4e80 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.644506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 185/361] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:30.645643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 177/362] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:30.645973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead06c6-24c6-4015-b0f7-523490e70a9a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:30.651733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c80d9-07ec-45c2-92e2-4b30e94f4e80 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:30.784044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead06c6-24c6-4015-b0f7-523490e70a9a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:30.806469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c80d9-07ec-45c2-92e2-4b30e94f4e80 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:30.822016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9a67d-41c2-40ba-a35a-9e81c76406d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:30.822681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a67d-41c2-40ba-a35a-9e81c76406d3 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.822986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a67d-41c2-40ba-a35a-9e81c76406d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.823539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a67d-41c2-40ba-a35a-9e81c76406d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.843477 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960b66f-59c4-45db-9dec-39d2f05d9ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:30.844464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960b66f-59c4-45db-9dec-39d2f05d9ceb None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.844938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960b66f-59c4-45db-9dec-39d2f05d9ceb None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.845411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960b66f-59c4-45db-9dec-39d2f05d9ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.846456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960b66f-59c4-45db-9dec-39d2f05d9ceb None admin] RBAC: Adding query filter params (role.id=f22059c052f142f7b64fe5c629e314c6, user.id=f61276c9353f4ed5923ef6a31fa76229, scope.system=all) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:30.846959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960b66f-59c4-45db-9dec-39d2f05d9ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:30.848742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960b66f-59c4-45db-9dec-39d2f05d9ceb None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:30.862706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 178/363] 10.222.0.75 () {56 vars in 1308 bytes} [Thu May 12 14:17:30 2022] GET /identity/v3/role_assignments?user.id=f61276c9353f4ed5923ef6a31fa76229&scope.system=all&role.id=f22059c052f142f7b64fe5c629e314c6 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:30.864368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb7f5-f121-4bb8-b3a3-eae40f5b86d5 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:30.864881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb7f5-f121-4bb8-b3a3-eae40f5b86d5 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:30.865359 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdedb7f5-f121-4bb8-b3a3-eae40f5b86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:30.885156 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-cdedb7f5-f121-4bb8-b3a3-eae40f5b86d5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:30.886749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cdedb7f5-f121-4bb8-b3a3-eae40f5b86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:30.897710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9a67d-41c2-40ba-a35a-9e81c76406d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:30.899792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9a67d-41c2-40ba-a35a-9e81c76406d3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:30.976532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 179/364] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:30.977711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedb7f5-f121-4bb8-b3a3-eae40f5b86d5 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:31.011061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 186/365] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:31.013158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9a67d-41c2-40ba-a35a-9e81c76406d3 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:31.108524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdedb7f5-f121-4bb8-b3a3-eae40f5b86d5 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:31.158642 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c69d-471c-4801-bf01-ad022e9001c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:31.159732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c69d-471c-4801-bf01-ad022e9001c1 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:31.159732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c69d-471c-4801-bf01-ad022e9001c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:31.160029 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c69d-471c-4801-bf01-ad022e9001c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:31.171960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9a67d-41c2-40ba-a35a-9e81c76406d3 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:31.173198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056c69d-471c-4801-bf01-ad022e9001c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-3056c69d-471c-4801-bf01-ad022e9001c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:31.182966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:31.183925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:31.184743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 180/366] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:31.185409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c69d-471c-4801-bf01-ad022e9001c1 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:31.228430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1bae3-9cb7-4218-818b-2e153184b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:31.229296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1bae3-9cb7-4218-818b-2e153184b57c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:31.229574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1bae3-9cb7-4218-818b-2e153184b57c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:31.229851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1bae3-9cb7-4218-818b-2e153184b57c None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:31.231081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1bae3-9cb7-4218-818b-2e153184b57c None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:31.232531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1bae3-9cb7-4218-818b-2e153184b57c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:31.234555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 187/367] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:31 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:31.239055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1bae3-9cb7-4218-818b-2e153184b57c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:31.315987 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c69d-471c-4801-bf01-ad022e9001c1 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:31.343081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1bae3-9cb7-4218-818b-2e153184b57c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:31.360506 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee843-c56e-4084-8544-1ca6d8fe351f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:31.361240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee843-c56e-4084-8544-1ca6d8fe351f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:31.361545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee843-c56e-4084-8544-1ca6d8fe351f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:31.361807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee843-c56e-4084-8544-1ca6d8fe351f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:31.372576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ee843-c56e-4084-8544-1ca6d8fe351f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-1c7ee843-c56e-4084-8544-1ca6d8fe351f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:31.382893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:31.384093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:31.384902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 181/368] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:17:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:31.385586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee843-c56e-4084-8544-1ca6d8fe351f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:31.388715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dad23-1d92-474a-be4a-f130eeb92b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:31.390137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dad23-1d92-474a-be4a-f130eeb92b50 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:31.390565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dad23-1d92-474a-be4a-f130eeb92b50 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:31.391022 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dad23-1d92-474a-be4a-f130eeb92b50 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:31.391973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dad23-1d92-474a-be4a-f130eeb92b50 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:31.392468 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dad23-1d92-474a-be4a-f130eeb92b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:31.394018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dad23-1d92-474a-be4a-f130eeb92b50 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:31.403151 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 188/369] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:31.404263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dad23-1d92-474a-be4a-f130eeb92b50 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:31.489683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee843-c56e-4084-8544-1ca6d8fe351f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:31.522266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dad23-1d92-474a-be4a-f130eeb92b50 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:31.524220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14a8a6-d61c-4d66-ada8-eb4c5f675ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:31.525290 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14a8a6-d61c-4d66-ada8-eb4c5f675ae6 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:31.525575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14a8a6-d61c-4d66-ada8-eb4c5f675ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:31.525851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14a8a6-d61c-4d66-ada8-eb4c5f675ae6 None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:31.527129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14a8a6-d61c-4d66-ada8-eb4c5f675ae6 None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:31.528641 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c14a8a6-d61c-4d66-ada8-eb4c5f675ae6 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:31.530651 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 182/370] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:31 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:31.531345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14a8a6-d61c-4d66-ada8-eb4c5f675ae6 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:31.561969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9dbac-37a1-41ea-bbd5-e0e393f85502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:31.562666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9dbac-37a1-41ea-bbd5-e0e393f85502 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:31.562964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9dbac-37a1-41ea-bbd5-e0e393f85502 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:31.563302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9dbac-37a1-41ea-bbd5-e0e393f85502 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:31.564056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9dbac-37a1-41ea-bbd5-e0e393f85502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:31.564363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9dbac-37a1-41ea-bbd5-e0e393f85502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:31.565802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9dbac-37a1-41ea-bbd5-e0e393f85502 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:31.575215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 189/371] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:31.575931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9dbac-37a1-41ea-bbd5-e0e393f85502 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:31.635865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14a8a6-d61c-4d66-ada8-eb4c5f675ae6 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:31.672857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5c58-9fa5-420b-83e2-359ccb50b314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:31.673810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5c58-9fa5-420b-83e2-359ccb50b314 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:31.674279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5c58-9fa5-420b-83e2-359ccb50b314 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:31.674764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5c58-9fa5-420b-83e2-359ccb50b314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:31.691793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9dbac-37a1-41ea-bbd5-e0e393f85502 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:31.731686 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543fe3f-fb78-4a51-8dde-f78a1c9d8e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:31.732361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543fe3f-fb78-4a51-8dde-f78a1c9d8e4d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:31.732647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543fe3f-fb78-4a51-8dde-f78a1c9d8e4d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:31.733090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543fe3f-fb78-4a51-8dde-f78a1c9d8e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:31.736300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543fe3f-fb78-4a51-8dde-f78a1c9d8e4d None admin] RBAC: Adding query filter params (group.id=21011426bf0e4cbd9ab8a1f49c712b87, role.id=2d441060f04441848c895dc5b9affb06, scope.project.id=4a5e849b81e744c08ab224f1f42af588) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:31.736673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543fe3f-fb78-4a51-8dde-f78a1c9d8e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:31.738143 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543fe3f-fb78-4a51-8dde-f78a1c9d8e4d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:31.750587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 190/372] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 12 14:17:31 2022] GET /identity/v3/role_assignments?group.id=21011426bf0e4cbd9ab8a1f49c712b87&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=2d441060f04441848c895dc5b9affb06 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:31.751600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543fe3f-fb78-4a51-8dde-f78a1c9d8e4d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:31.751926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d5c58-9fa5-420b-83e2-359ccb50b314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:31.753612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d5c58-9fa5-420b-83e2-359ccb50b314 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:31.952135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543fe3f-fb78-4a51-8dde-f78a1c9d8e4d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:31.963919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 183/373] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:31.975209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5c58-9fa5-420b-83e2-359ccb50b314 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:32.025210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edb3c1-8e2f-4d87-9a0b-4da6e6a2e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:32.026589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edb3c1-8e2f-4d87-9a0b-4da6e6a2e528 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:32.027090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edb3c1-8e2f-4d87-9a0b-4da6e6a2e528 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:32.027578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edb3c1-8e2f-4d87-9a0b-4da6e6a2e528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:32.114464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edb3c1-8e2f-4d87-9a0b-4da6e6a2e528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:32.116090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edb3c1-8e2f-4d87-9a0b-4da6e6a2e528 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:32.156862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5c58-9fa5-420b-83e2-359ccb50b314 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:32.212787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a22bb-fdb3-452a-b04e-f7f305b79b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:32.214387 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a22bb-fdb3-452a-b04e-f7f305b79b21 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:32.214851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a22bb-fdb3-452a-b04e-f7f305b79b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:32.215353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a22bb-fdb3-452a-b04e-f7f305b79b21 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:32.218278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 191/374] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:32.218976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a22bb-fdb3-452a-b04e-f7f305b79b21 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:32.221002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a22bb-fdb3-452a-b04e-f7f305b79b21 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:32.223369 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 184/375] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:31 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:32.226597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edb3c1-8e2f-4d87-9a0b-4da6e6a2e528 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:32.237776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a22bb-fdb3-452a-b04e-f7f305b79b21 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:32.335184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edb3c1-8e2f-4d87-9a0b-4da6e6a2e528 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:32.373385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5aa34-728a-4362-80a4-7a6fa292bcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:32.374261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5aa34-728a-4362-80a4-7a6fa292bcf2 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:32.374543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5aa34-728a-4362-80a4-7a6fa292bcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:32.375069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5aa34-728a-4362-80a4-7a6fa292bcf2 None admin] PATH_INFO: `/v3/projects/b51fa73b4d054aee9ce299da7ce9ee7a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:32.379865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5aa34-728a-4362-80a4-7a6fa292bcf2 None admin] RBAC: Authorizing `identity:get_project(project_id=b51fa73b4d054aee9ce299da7ce9ee7a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:32.381355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5aa34-728a-4362-80a4-7a6fa292bcf2 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:32.383335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 192/376] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:32 2022] GET /identity/v3/projects/b51fa73b4d054aee9ce299da7ce9ee7a => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:32.390521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5aa34-728a-4362-80a4-7a6fa292bcf2 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:32.399127 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a22bb-fdb3-452a-b04e-f7f305b79b21 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:32.480193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c713a-bff0-4c2a-988f-4757868a5def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:32.480998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c713a-bff0-4c2a-988f-4757868a5def None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:32.481281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c713a-bff0-4c2a-988f-4757868a5def None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:32.481553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c713a-bff0-4c2a-988f-4757868a5def None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:32.487891 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c713a-bff0-4c2a-988f-4757868a5def None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:32.489394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c713a-bff0-4c2a-988f-4757868a5def None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:32.491506 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 185/377] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:32 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:32.496746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c713a-bff0-4c2a-988f-4757868a5def None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:32.508025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5aa34-728a-4362-80a4-7a6fa292bcf2 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:32.550587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b0646-d6d3-451b-9f59-c21838a9d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:32.551492 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b0646-d6d3-451b-9f59-c21838a9d4fb None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:32.551772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b0646-d6d3-451b-9f59-c21838a9d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:32.552055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b0646-d6d3-451b-9f59-c21838a9d4fb None admin] PATH_INFO: `/v3/groups/b4e04361145b45f5a883ac16a3d7f16b` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:32.564562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b0646-d6d3-451b-9f59-c21838a9d4fb None admin] RBAC: Authorizing `identity:get_group(group_id=b4e04361145b45f5a883ac16a3d7f16b)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:32.566038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b0646-d6d3-451b-9f59-c21838a9d4fb None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:32.567815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 193/378] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:32 2022] GET /identity/v3/groups/b4e04361145b45f5a883ac16a3d7f16b => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:32.575130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b0646-d6d3-451b-9f59-c21838a9d4fb None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:32.633471 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c713a-bff0-4c2a-988f-4757868a5def None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:32.692012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a64dc-08ad-42c5-b17e-b97c80679951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:32.693025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a64dc-08ad-42c5-b17e-b97c80679951 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:32.693518 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a64dc-08ad-42c5-b17e-b97c80679951 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:32.693968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a64dc-08ad-42c5-b17e-b97c80679951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:32.695124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a64dc-08ad-42c5-b17e-b97c80679951 None admin] RBAC: Adding query filter params (group.id=21011426bf0e4cbd9ab8a1f49c712b87, role.id=8b437ce0fad84637a68c6c151d4e2c5c, scope.project.id=4a5e849b81e744c08ab224f1f42af588) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:32.695618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a64dc-08ad-42c5-b17e-b97c80679951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:32.697985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a64dc-08ad-42c5-b17e-b97c80679951 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:32.710817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 186/379] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 12 14:17:32 2022] GET /identity/v3/role_assignments?group.id=21011426bf0e4cbd9ab8a1f49c712b87&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=8b437ce0fad84637a68c6c151d4e2c5c => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:32.756997 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b0646-d6d3-451b-9f59-c21838a9d4fb None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:32.796806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65e7bc-9936-4a48-a702-2384ecd1b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:32.797791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65e7bc-9936-4a48-a702-2384ecd1b88d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:32.798253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65e7bc-9936-4a48-a702-2384ecd1b88d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:32.798735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65e7bc-9936-4a48-a702-2384ecd1b88d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:32.799788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65e7bc-9936-4a48-a702-2384ecd1b88d None admin] RBAC: Adding query filter params (group.id=b4e04361145b45f5a883ac16a3d7f16b, role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=b51fa73b4d054aee9ce299da7ce9ee7a) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:32.800284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65e7bc-9936-4a48-a702-2384ecd1b88d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:32.801968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65e7bc-9936-4a48-a702-2384ecd1b88d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:32.809006 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 194/380] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 12 14:17:32 2022] GET /identity/v3/role_assignments?group.id=b4e04361145b45f5a883ac16a3d7f16b&scope.project.id=b51fa73b4d054aee9ce299da7ce9ee7a&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:33.126242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b917f-43f3-4f67-a978-8aee9de434c8 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:33.126624 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b917f-43f3-4f67-a978-8aee9de434c8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:33.126803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b917f-43f3-4f67-a978-8aee9de434c8 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:33.128525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 187/381] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:33.134629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d5888-47ef-4f83-8d77-e61629693f9e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:33.134967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d5888-47ef-4f83-8d77-e61629693f9e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:33.135230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d5888-47ef-4f83-8d77-e61629693f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:33.160844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-e61d5888-47ef-4f83-8d77-e61629693f9e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:33.162071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e61d5888-47ef-4f83-8d77-e61629693f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:33.264673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 195/382] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:33.309549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b917f-43f3-4f67-a978-8aee9de434c8 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:33.363333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8be3-2ec3-4b8d-a65c-da8dd4a59827 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:33.364282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8be3-2ec3-4b8d-a65c-da8dd4a59827 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:33.364780 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f8be3-2ec3-4b8d-a65c-da8dd4a59827 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:33.367805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 196/383] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:33.372466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e06e63-0cbf-4da7-a9bb-7fe8b1c9b555 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:33.373042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e06e63-0cbf-4da7-a9bb-7fe8b1c9b555 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:33.374091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e06e63-0cbf-4da7-a9bb-7fe8b1c9b555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:33.398596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-55e06e63-0cbf-4da7-a9bb-7fe8b1c9b555 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:33.400232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-55e06e63-0cbf-4da7-a9bb-7fe8b1c9b555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:33.475150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 197/384] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:33.488323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b917f-43f3-4f67-a978-8aee9de434c8 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:33.495780 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e06e63-0cbf-4da7-a9bb-7fe8b1c9b555 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:33.544340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff06fc-192d-45ea-afb3-4e26d42033c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:33.545035 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff06fc-192d-45ea-afb3-4e26d42033c6 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:33.545342 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff06fc-192d-45ea-afb3-4e26d42033c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:33.545612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff06fc-192d-45ea-afb3-4e26d42033c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:33.576038 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff06fc-192d-45ea-afb3-4e26d42033c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c2ff06fc-192d-45ea-afb3-4e26d42033c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:33.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:33.585883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:33.586699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:33.591526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 188/385] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:33.597916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff06fc-192d-45ea-afb3-4e26d42033c6 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:33.607069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e06e63-0cbf-4da7-a9bb-7fe8b1c9b555 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:33.643058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537be574-8da5-4017-a4e0-9f04f0d04c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:33.644345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537be574-8da5-4017-a4e0-9f04f0d04c41 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:33.644834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537be574-8da5-4017-a4e0-9f04f0d04c41 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:33.645314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537be574-8da5-4017-a4e0-9f04f0d04c41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:33.657450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537be574-8da5-4017-a4e0-9f04f0d04c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-537be574-8da5-4017-a4e0-9f04f0d04c41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:33.665987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:33.666904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:33.667735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:33.674906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 198/386] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:33.676436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537be574-8da5-4017-a4e0-9f04f0d04c41 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:33.782609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537be574-8da5-4017-a4e0-9f04f0d04c41 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:33.804910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff06fc-192d-45ea-afb3-4e26d42033c6 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:33.818517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f114-56c7-4a9f-8722-b4039111392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:33.819582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f114-56c7-4a9f-8722-b4039111392a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:33.820082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f114-56c7-4a9f-8722-b4039111392a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:33.820622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6f114-56c7-4a9f-8722-b4039111392a None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:33.821592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6f114-56c7-4a9f-8722-b4039111392a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:33.822114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6f114-56c7-4a9f-8722-b4039111392a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:33.823726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f6f114-56c7-4a9f-8722-b4039111392a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:33.837740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 199/387] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:33.839397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f114-56c7-4a9f-8722-b4039111392a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:33.864313 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b0efb-f79f-4298-88bf-cb9e5ad01e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:33.865347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0efb-f79f-4298-88bf-cb9e5ad01e01 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:33.865347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0efb-f79f-4298-88bf-cb9e5ad01e01 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:33.865621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b0efb-f79f-4298-88bf-cb9e5ad01e01 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:33.866404 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b0efb-f79f-4298-88bf-cb9e5ad01e01 None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:33.866718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b0efb-f79f-4298-88bf-cb9e5ad01e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:33.868164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b0efb-f79f-4298-88bf-cb9e5ad01e01 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:33.890851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 189/388] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:33.897077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b0efb-f79f-4298-88bf-cb9e5ad01e01 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:33.954528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6f114-56c7-4a9f-8722-b4039111392a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:34.001676 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87507ef8-37cc-449a-a099-8f66ec1c0e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:34.003543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87507ef8-37cc-449a-a099-8f66ec1c0e9a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:34.004035 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87507ef8-37cc-449a-a099-8f66ec1c0e9a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:34.004513 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87507ef8-37cc-449a-a099-8f66ec1c0e9a None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:34.005936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87507ef8-37cc-449a-a099-8f66ec1c0e9a None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:34.007788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87507ef8-37cc-449a-a099-8f66ec1c0e9a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:34.014164 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 200/389] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:33 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:34.015646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87507ef8-37cc-449a-a099-8f66ec1c0e9a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:34.128232 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b0efb-f79f-4298-88bf-cb9e5ad01e01 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:34.173482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6282033-6428-4546-95d5-b23aba08c14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:34.174757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6282033-6428-4546-95d5-b23aba08c14b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:34.175309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6282033-6428-4546-95d5-b23aba08c14b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:34.175789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6282033-6428-4546-95d5-b23aba08c14b None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:34.177224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6282033-6428-4546-95d5-b23aba08c14b None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:34.181177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6282033-6428-4546-95d5-b23aba08c14b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:34.183707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 190/390] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:33 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:34.192221 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6282033-6428-4546-95d5-b23aba08c14b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:34.210892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87507ef8-37cc-449a-a099-8f66ec1c0e9a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:34.248709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010b59d-e88e-4407-b59a-4e1d07d0dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:34.249571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010b59d-e88e-4407-b59a-4e1d07d0dd55 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:34.249854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010b59d-e88e-4407-b59a-4e1d07d0dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:34.250129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a010b59d-e88e-4407-b59a-4e1d07d0dd55 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:34.251365 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010b59d-e88e-4407-b59a-4e1d07d0dd55 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:34.252915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a010b59d-e88e-4407-b59a-4e1d07d0dd55 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:34.259055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 201/391] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:34 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:34.261675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010b59d-e88e-4407-b59a-4e1d07d0dd55 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:34.317768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6282033-6428-4546-95d5-b23aba08c14b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:34.354004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb91dd-dabc-4265-b371-a792849a96b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:34.354914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb91dd-dabc-4265-b371-a792849a96b8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:34.355267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb91dd-dabc-4265-b371-a792849a96b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:34.355517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb91dd-dabc-4265-b371-a792849a96b8 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:34.356834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb91dd-dabc-4265-b371-a792849a96b8 None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:34.358334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb91dd-dabc-4265-b371-a792849a96b8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:34.360415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 191/392] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:34 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:34.366200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb91dd-dabc-4265-b371-a792849a96b8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:34.373394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a010b59d-e88e-4407-b59a-4e1d07d0dd55 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:34.410080 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8391cc-98a9-49c3-969c-f309c1c2609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:34.411997 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8391cc-98a9-49c3-969c-f309c1c2609f None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:34.412691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8391cc-98a9-49c3-969c-f309c1c2609f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:34.413361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8391cc-98a9-49c3-969c-f309c1c2609f None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0/groups/21011426bf0e4cbd9ab8a1f49c712b87/roles/8b437ce0fad84637a68c6c151d4e2c5c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:34.417199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8391cc-98a9-49c3-969c-f309c1c2609f None admin] RBAC: Authorizing `identity:create_grant(project_id=540bf727f064487c930910ee34bc6da0, group_id=21011426bf0e4cbd9ab8a1f49c712b87, role_id=8b437ce0fad84637a68c6c151d4e2c5c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:34.419788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8391cc-98a9-49c3-969c-f309c1c2609f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:34.449130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 202/393] 10.222.0.75 () {58 vars in 1442 bytes} [Thu May 12 14:17:34 2022] PUT /identity/v3/projects/540bf727f064487c930910ee34bc6da0/groups/21011426bf0e4cbd9ab8a1f49c712b87/roles/8b437ce0fad84637a68c6c151d4e2c5c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:17:34.482867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb91dd-dabc-4265-b371-a792849a96b8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:34.525937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac4cff-a4b3-4cc2-b4ec-c8748d7908a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:34.526928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac4cff-a4b3-4cc2-b4ec-c8748d7908a7 None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:34.527295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac4cff-a4b3-4cc2-b4ec-c8748d7908a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:34.527568 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac4cff-a4b3-4cc2-b4ec-c8748d7908a7 None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0/groups/21011426bf0e4cbd9ab8a1f49c712b87/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:34.529760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac4cff-a4b3-4cc2-b4ec-c8748d7908a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=540bf727f064487c930910ee34bc6da0, group_id=21011426bf0e4cbd9ab8a1f49c712b87, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:34.531463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac4cff-a4b3-4cc2-b4ec-c8748d7908a7 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:34.557432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 192/394] 10.222.0.75 () {58 vars in 1442 bytes} [Thu May 12 14:17:34 2022] PUT /identity/v3/projects/540bf727f064487c930910ee34bc6da0/groups/21011426bf0e4cbd9ab8a1f49c712b87/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:17:35.012915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67318a-7dee-483e-8886-e5c1be5422b2 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:35.013575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67318a-7dee-483e-8886-e5c1be5422b2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:35.014646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67318a-7dee-483e-8886-e5c1be5422b2 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:35.016471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 203/395] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:35.022246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b154-3803-4824-be9e-63f91a12ba79 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:35.022539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b154-3803-4824-be9e-63f91a12ba79 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:35.022821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1b154-3803-4824-be9e-63f91a12ba79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:35.047677 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-93b1b154-3803-4824-be9e-63f91a12ba79 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:35.048896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-93b1b154-3803-4824-be9e-63f91a12ba79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:35.133159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 193/396] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:35.167742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67318a-7dee-483e-8886-e5c1be5422b2 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:35.292923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67318a-7dee-483e-8886-e5c1be5422b2 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:35.330895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3a98f-f149-4564-bff7-da3e962cd601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:35.331747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3a98f-f149-4564-bff7-da3e962cd601 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:35.332025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3a98f-f149-4564-bff7-da3e962cd601 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:35.332306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3a98f-f149-4564-bff7-da3e962cd601 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:35.345956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3a98f-f149-4564-bff7-da3e962cd601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-8da3a98f-f149-4564-bff7-da3e962cd601 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:35.354041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:35.354946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:35.355781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 204/397] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:35.364925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b154-3803-4824-be9e-63f91a12ba79 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:35.504140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1b154-3803-4824-be9e-63f91a12ba79 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:35.542297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193091a-10ea-4f31-902e-92028daae828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:35.543456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193091a-10ea-4f31-902e-92028daae828 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:35.543946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193091a-10ea-4f31-902e-92028daae828 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:35.544505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193091a-10ea-4f31-902e-92028daae828 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:35.546105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193091a-10ea-4f31-902e-92028daae828 None admin] RBAC: Adding query filter params (name=member) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:35.546632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193091a-10ea-4f31-902e-92028daae828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:35.548340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193091a-10ea-4f31-902e-92028daae828 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:35.558058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 194/398] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:35.563867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3a98f-f149-4564-bff7-da3e962cd601 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:35.614378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccfce9-e8af-4de4-9c22-02ad6610e49e None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:35.614775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccfce9-e8af-4de4-9c22-02ad6610e49e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:35.615067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccfce9-e8af-4de4-9c22-02ad6610e49e None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:35.617003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 195/399] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:35.625017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e78b3-1b08-4064-bb50-7e9e4ea4f156 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:35.625487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e78b3-1b08-4064-bb50-7e9e4ea4f156 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:35.625864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e78b3-1b08-4064-bb50-7e9e4ea4f156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:35.664169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-8d2e78b3-1b08-4064-bb50-7e9e4ea4f156 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:35.665479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8d2e78b3-1b08-4064-bb50-7e9e4ea4f156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:35.734554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3a98f-f149-4564-bff7-da3e962cd601 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:35.780784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611986f-bbc1-4d70-ac8a-16cbaf405fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:35.781658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611986f-bbc1-4d70-ac8a-16cbaf405fd9 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:35.781941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611986f-bbc1-4d70-ac8a-16cbaf405fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:35.782207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611986f-bbc1-4d70-ac8a-16cbaf405fd9 None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:35.783423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611986f-bbc1-4d70-ac8a-16cbaf405fd9 None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:35.784863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611986f-bbc1-4d70-ac8a-16cbaf405fd9 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:35.786776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 205/400] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:35 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:35.791154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 196/401] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:35.792032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611986f-bbc1-4d70-ac8a-16cbaf405fd9 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:35.816032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e78b3-1b08-4064-bb50-7e9e4ea4f156 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:35.936655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611986f-bbc1-4d70-ac8a-16cbaf405fd9 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:35.964708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e78b3-1b08-4064-bb50-7e9e4ea4f156 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:36.004683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59c1a6-8b4d-4b3b-914d-52c809e56675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:36.005561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59c1a6-8b4d-4b3b-914d-52c809e56675 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:36.005688 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d56b0b-8f9b-443f-ac20-676690977865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:36.005920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59c1a6-8b4d-4b3b-914d-52c809e56675 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:36.006117 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59c1a6-8b4d-4b3b-914d-52c809e56675 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:36.006479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56b0b-8f9b-443f-ac20-676690977865 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:36.006868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56b0b-8f9b-443f-ac20-676690977865 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:36.007184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56b0b-8f9b-443f-ac20-676690977865 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:36.011861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59c1a6-8b4d-4b3b-914d-52c809e56675 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:36.013504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59c1a6-8b4d-4b3b-914d-52c809e56675 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:36.015667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 206/402] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:35 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:36.019536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d56b0b-8f9b-443f-ac20-676690977865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:36.022196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59c1a6-8b4d-4b3b-914d-52c809e56675 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-06d56b0b-8f9b-443f-ac20-676690977865 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:36.028487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:36.029944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:36.030772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:36.035061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 197/403] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:36.036395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d56b0b-8f9b-443f-ac20-676690977865 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:36.144517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d56b0b-8f9b-443f-ac20-676690977865 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:36.181232 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2404c0-4c5d-487c-9f66-01f4199842c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:36.181920 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2404c0-4c5d-487c-9f66-01f4199842c6 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:36.182207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2404c0-4c5d-487c-9f66-01f4199842c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:36.182485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2404c0-4c5d-487c-9f66-01f4199842c6 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:36.183296 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2404c0-4c5d-487c-9f66-01f4199842c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:36.183678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2404c0-4c5d-487c-9f66-01f4199842c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:36.186309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2404c0-4c5d-487c-9f66-01f4199842c6 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:36.199562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 198/404] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:36.202660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2404c0-4c5d-487c-9f66-01f4199842c6 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:36.301058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59c1a6-8b4d-4b3b-914d-52c809e56675 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:36.311564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2404c0-4c5d-487c-9f66-01f4199842c6 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:36.351066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366599ec-2264-4cc4-8699-96fef12a859b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:36.351982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366599ec-2264-4cc4-8699-96fef12a859b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:36.352268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366599ec-2264-4cc4-8699-96fef12a859b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:36.352548 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366599ec-2264-4cc4-8699-96fef12a859b None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:36.353839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366599ec-2264-4cc4-8699-96fef12a859b None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:36.355350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366599ec-2264-4cc4-8699-96fef12a859b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:36.362161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 199/405] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:36 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:36.363535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366599ec-2264-4cc4-8699-96fef12a859b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:36.397003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfdd2a-6df1-42c7-a5ca-c47c1c48f067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:36.397825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfdd2a-6df1-42c7-a5ca-c47c1c48f067 None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:36.398113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfdd2a-6df1-42c7-a5ca-c47c1c48f067 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:36.398389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfdd2a-6df1-42c7-a5ca-c47c1c48f067 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588/groups/21011426bf0e4cbd9ab8a1f49c712b87/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:36.404515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfdd2a-6df1-42c7-a5ca-c47c1c48f067 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a5e849b81e744c08ab224f1f42af588, group_id=21011426bf0e4cbd9ab8a1f49c712b87, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:36.406497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfdd2a-6df1-42c7-a5ca-c47c1c48f067 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:36.445627 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 207/406] 10.222.0.75 () {58 vars in 1442 bytes} [Thu May 12 14:17:36 2022] PUT /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588/groups/21011426bf0e4cbd9ab8a1f49c712b87/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:17:36.472321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366599ec-2264-4cc4-8699-96fef12a859b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:36.520969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa645ab-cfd7-41da-b489-5e36f1e752cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:36.522125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa645ab-cfd7-41da-b489-5e36f1e752cd None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:36.522411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa645ab-cfd7-41da-b489-5e36f1e752cd None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:36.522741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa645ab-cfd7-41da-b489-5e36f1e752cd None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:36.524090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa645ab-cfd7-41da-b489-5e36f1e752cd None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:36.525597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa645ab-cfd7-41da-b489-5e36f1e752cd None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:36.530739 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 200/407] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:36 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:36.536146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfdd2a-6df1-42c7-a5ca-c47c1c48f067 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:36.556985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4589e87-62d2-4cef-bd03-5d48840d5b00 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:36.557564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4589e87-62d2-4cef-bd03-5d48840d5b00 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:36.558051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4589e87-62d2-4cef-bd03-5d48840d5b00 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:36.560030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 201/408] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:36.566193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bab2ec-ddba-45a8-baf3-3c0e0cb4f298 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:36.566778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bab2ec-ddba-45a8-baf3-3c0e0cb4f298 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:36.567319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bab2ec-ddba-45a8-baf3-3c0e0cb4f298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:36.588299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b7bab2ec-ddba-45a8-baf3-3c0e0cb4f298 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:36.590408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b7bab2ec-ddba-45a8-baf3-3c0e0cb4f298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:36.700700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 202/409] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:36.733905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bab2ec-ddba-45a8-baf3-3c0e0cb4f298 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:36.741468 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfdd2a-6df1-42c7-a5ca-c47c1c48f067 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:36.777720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dab7f2-bf1a-4ed3-9567-c335c4636a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:36.778627 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab7f2-bf1a-4ed3-9567-c335c4636a8f None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:36.778913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab7f2-bf1a-4ed3-9567-c335c4636a8f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:36.779223 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab7f2-bf1a-4ed3-9567-c335c4636a8f None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588/groups/21011426bf0e4cbd9ab8a1f49c712b87/roles/8b437ce0fad84637a68c6c151d4e2c5c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:36.782808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dab7f2-bf1a-4ed3-9567-c335c4636a8f None admin] RBAC: Authorizing `identity:create_grant(project_id=4a5e849b81e744c08ab224f1f42af588, group_id=21011426bf0e4cbd9ab8a1f49c712b87, role_id=8b437ce0fad84637a68c6c151d4e2c5c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:36.783735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dab7f2-bf1a-4ed3-9567-c335c4636a8f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:36.806516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 208/410] 10.222.0.75 () {58 vars in 1442 bytes} [Thu May 12 14:17:36 2022] PUT /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588/groups/21011426bf0e4cbd9ab8a1f49c712b87/roles/8b437ce0fad84637a68c6c151d4e2c5c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:17:36.873173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bab2ec-ddba-45a8-baf3-3c0e0cb4f298 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:36.919069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0696365-7cfb-4686-a91a-3fb7064b16e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:36.919895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0696365-7cfb-4686-a91a-3fb7064b16e4 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:36.920720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0696365-7cfb-4686-a91a-3fb7064b16e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:36.920999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0696365-7cfb-4686-a91a-3fb7064b16e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:36.941257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0696365-7cfb-4686-a91a-3fb7064b16e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-a0696365-7cfb-4686-a91a-3fb7064b16e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:36.954319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:36.956897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:36.960079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 203/411] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:17:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:36.964567 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dab7f2-bf1a-4ed3-9567-c335c4636a8f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:37.170268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dab7f2-bf1a-4ed3-9567-c335c4636a8f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:37.217615 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd226db3-2bf7-4911-880d-b3aeb1643fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:37.218657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd226db3-2bf7-4911-880d-b3aeb1643fac None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:37.219169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd226db3-2bf7-4911-880d-b3aeb1643fac None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:37.219647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd226db3-2bf7-4911-880d-b3aeb1643fac None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:37.220607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd226db3-2bf7-4911-880d-b3aeb1643fac None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:37.221137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd226db3-2bf7-4911-880d-b3aeb1643fac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:37.222738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd226db3-2bf7-4911-880d-b3aeb1643fac None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:37.232902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 209/412] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:37.246744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0696365-7cfb-4686-a91a-3fb7064b16e4 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:37.375629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0696365-7cfb-4686-a91a-3fb7064b16e4 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:37.418077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a058497-2b14-403b-8418-4f7999758dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:37.418953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a058497-2b14-403b-8418-4f7999758dd3 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:37.419264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a058497-2b14-403b-8418-4f7999758dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:37.419541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a058497-2b14-403b-8418-4f7999758dd3 None admin] PATH_INFO: `/v3/groups/b4e04361145b45f5a883ac16a3d7f16b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:37.420785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a058497-2b14-403b-8418-4f7999758dd3 None admin] RBAC: Authorizing `identity:get_group(group_id=b4e04361145b45f5a883ac16a3d7f16b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:37.422268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a058497-2b14-403b-8418-4f7999758dd3 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:37.424312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 204/413] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:37 2022] GET /identity/v3/groups/b4e04361145b45f5a883ac16a3d7f16b => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:37.429854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd226db3-2bf7-4911-880d-b3aeb1643fac None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:37.467133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437fe5-487c-4a0c-a306-b0441d228015 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:37.467450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437fe5-487c-4a0c-a306-b0441d228015 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:37.467757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437fe5-487c-4a0c-a306-b0441d228015 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:37.469621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 205/414] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:37.475014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e130-fd11-475b-acfb-bf2e3f257bc8 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:37.475648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e130-fd11-475b-acfb-bf2e3f257bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:37.475648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42e130-fd11-475b-acfb-bf2e3f257bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:37.504193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6b42e130-fd11-475b-acfb-bf2e3f257bc8 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:37.505409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6b42e130-fd11-475b-acfb-bf2e3f257bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:37.556191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd226db3-2bf7-4911-880d-b3aeb1643fac None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:37.591436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887f2ec-6602-4d5c-b290-a3b1398c4cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:37.592700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887f2ec-6602-4d5c-b290-a3b1398c4cbf None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:37.593212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887f2ec-6602-4d5c-b290-a3b1398c4cbf None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:37.593686 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887f2ec-6602-4d5c-b290-a3b1398c4cbf None admin] PATH_INFO: `/v3/projects/b51fa73b4d054aee9ce299da7ce9ee7a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:37.595176 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887f2ec-6602-4d5c-b290-a3b1398c4cbf None admin] RBAC: Authorizing `identity:get_project(project_id=b51fa73b4d054aee9ce299da7ce9ee7a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:37.596844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887f2ec-6602-4d5c-b290-a3b1398c4cbf None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:37.603151 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 210/415] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:37 2022] GET /identity/v3/projects/b51fa73b4d054aee9ce299da7ce9ee7a => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:37.604949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887f2ec-6602-4d5c-b290-a3b1398c4cbf None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:37.622224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 206/416] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:37.635574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4a27d-377c-4336-9e03-c6b53201760f None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:37.635867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4a27d-377c-4336-9e03-c6b53201760f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:37.636398 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4a27d-377c-4336-9e03-c6b53201760f None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:37.637815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 207/417] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:37.648274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e87d5-6475-4bfa-aed8-43752446017e None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:37.648554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e87d5-6475-4bfa-aed8-43752446017e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:37.648901 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e87d5-6475-4bfa-aed8-43752446017e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:37.668843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d14e87d5-6475-4bfa-aed8-43752446017e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:37.670586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d14e87d5-6475-4bfa-aed8-43752446017e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:37.731366 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887f2ec-6602-4d5c-b290-a3b1398c4cbf None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:37.739556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 208/418] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:37.741004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e87d5-6475-4bfa-aed8-43752446017e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:37.791732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337d3e3-5519-4f7a-848c-eb13a049b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:37.792616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337d3e3-5519-4f7a-848c-eb13a049b88f None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:37.792897 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337d3e3-5519-4f7a-848c-eb13a049b88f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:37.793170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337d3e3-5519-4f7a-848c-eb13a049b88f None admin] PATH_INFO: `/v3/projects/b51fa73b4d054aee9ce299da7ce9ee7a/groups/b4e04361145b45f5a883ac16a3d7f16b/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:37.795719 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337d3e3-5519-4f7a-848c-eb13a049b88f None admin] RBAC: Authorizing `identity:create_grant(project_id=b51fa73b4d054aee9ce299da7ce9ee7a, group_id=b4e04361145b45f5a883ac16a3d7f16b, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:37.797317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337d3e3-5519-4f7a-848c-eb13a049b88f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:37.820476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 211/419] 10.222.0.75 () {58 vars in 1442 bytes} [Thu May 12 14:17:37 2022] PUT /identity/v3/projects/b51fa73b4d054aee9ce299da7ce9ee7a/groups/b4e04361145b45f5a883ac16a3d7f16b/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:17:37.827071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337d3e3-5519-4f7a-848c-eb13a049b88f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:37.861399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e87d5-6475-4bfa-aed8-43752446017e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:37.909703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95aba9-cae4-4544-ba97-241113cf9b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:37.909703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95aba9-cae4-4544-ba97-241113cf9b1f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:37.909703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95aba9-cae4-4544-ba97-241113cf9b1f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:37.912071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95aba9-cae4-4544-ba97-241113cf9b1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:37.942981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95aba9-cae4-4544-ba97-241113cf9b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-7b95aba9-cae4-4544-ba97-241113cf9b1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:37.953165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:37.954139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:37.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 209/420] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:37.965014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95aba9-cae4-4544-ba97-241113cf9b1f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:38.047164 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337d3e3-5519-4f7a-848c-eb13a049b88f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:38.106424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa85c1-eb2a-46ab-8706-8bad24900fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:38.107280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa85c1-eb2a-46ab-8706-8bad24900fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:38.108308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa85c1-eb2a-46ab-8706-8bad24900fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:38.108308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa85c1-eb2a-46ab-8706-8bad24900fa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:38.127571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa85c1-eb2a-46ab-8706-8bad24900fa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-0baa85c1-eb2a-46ab-8706-8bad24900fa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:38.137597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:38.138652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:38.140175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:38.140795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 212/421] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:38.146042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa85c1-eb2a-46ab-8706-8bad24900fa8 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:38.154239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95aba9-cae4-4544-ba97-241113cf9b1f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:38.226810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc22c4-a0b3-4493-97cb-420fef10c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:38.227519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc22c4-a0b3-4493-97cb-420fef10c7cf None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:38.227812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc22c4-a0b3-4493-97cb-420fef10c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:38.228090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc22c4-a0b3-4493-97cb-420fef10c7cf None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:38.228860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc22c4-a0b3-4493-97cb-420fef10c7cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:38.229167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc22c4-a0b3-4493-97cb-420fef10c7cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:38.230576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc22c4-a0b3-4493-97cb-420fef10c7cf None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:38.244521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 210/422] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:38.250457 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc22c4-a0b3-4493-97cb-420fef10c7cf None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:38.330347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa85c1-eb2a-46ab-8706-8bad24900fa8 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:38.380621 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a54fd-3f73-4570-beef-71c17b203b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:38.381307 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a54fd-3f73-4570-beef-71c17b203b23 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:38.381625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a54fd-3f73-4570-beef-71c17b203b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:38.381872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a54fd-3f73-4570-beef-71c17b203b23 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:38.382629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a54fd-3f73-4570-beef-71c17b203b23 None admin] RBAC: Adding query filter params (name=member) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:38.382942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a54fd-3f73-4570-beef-71c17b203b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:38.387050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a54fd-3f73-4570-beef-71c17b203b23 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:38.393765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 213/423] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:38.398991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a54fd-3f73-4570-beef-71c17b203b23 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:38.469616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc22c4-a0b3-4493-97cb-420fef10c7cf None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:38.514863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a54fd-3f73-4570-beef-71c17b203b23 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:38.515089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1932c6-daf8-4009-9dea-070649b3c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:38.515700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1932c6-daf8-4009-9dea-070649b3c05a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:38.515908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1932c6-daf8-4009-9dea-070649b3c05a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:38.516183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1932c6-daf8-4009-9dea-070649b3c05a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:38.577887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383ca0b-082f-4ab0-a312-795fbe00a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:38.578743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383ca0b-082f-4ab0-a312-795fbe00a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:38.579023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383ca0b-082f-4ab0-a312-795fbe00a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:38.581679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383ca0b-082f-4ab0-a312-795fbe00a4a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:38.658515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1932c6-daf8-4009-9dea-070649b3c05a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:38.660007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1932c6-daf8-4009-9dea-070649b3c05a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:38.670923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383ca0b-082f-4ab0-a312-795fbe00a4a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:38.672414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383ca0b-082f-4ab0-a312-795fbe00a4a8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:38.774530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 214/424] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:17:38.780434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383ca0b-082f-4ab0-a312-795fbe00a4a8 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:38.811844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 211/425] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:38.818612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1932c6-daf8-4009-9dea-070649b3c05a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:38.886148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383ca0b-082f-4ab0-a312-795fbe00a4a8 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:38.921607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b98495-cfdb-4061-bf26-b75e85c49b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:38.922476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b98495-cfdb-4061-bf26-b75e85c49b5b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:38.922757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b98495-cfdb-4061-bf26-b75e85c49b5b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:38.923114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b98495-cfdb-4061-bf26-b75e85c49b5b None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:38.924390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b98495-cfdb-4061-bf26-b75e85c49b5b None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:38.925882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b98495-cfdb-4061-bf26-b75e85c49b5b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:38.927997 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 215/426] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:38 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:38.933357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b98495-cfdb-4061-bf26-b75e85c49b5b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:38.945001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1932c6-daf8-4009-9dea-070649b3c05a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:38.981603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3474a4-b404-4eba-aeb5-4790d8069a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:38.982611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3474a4-b404-4eba-aeb5-4790d8069a2b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:38.983449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3474a4-b404-4eba-aeb5-4790d8069a2b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:38.983729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3474a4-b404-4eba-aeb5-4790d8069a2b None admin] PATH_INFO: `/v3/projects/540bf727f064487c930910ee34bc6da0` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:38.985013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3474a4-b404-4eba-aeb5-4790d8069a2b None admin] RBAC: Authorizing `identity:get_project(project_id=540bf727f064487c930910ee34bc6da0)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:38.986494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3474a4-b404-4eba-aeb5-4790d8069a2b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:38.988750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 212/427] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:38 2022] GET /identity/v3/projects/540bf727f064487c930910ee34bc6da0 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:38.996656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3474a4-b404-4eba-aeb5-4790d8069a2b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:39.108249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b98495-cfdb-4061-bf26-b75e85c49b5b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:39.153988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3474a4-b404-4eba-aeb5-4790d8069a2b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:39.181714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3942305-56ce-4d2d-b0f6-3ed51ecbbfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:39.182661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3942305-56ce-4d2d-b0f6-3ed51ecbbfed None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:39.182947 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3942305-56ce-4d2d-b0f6-3ed51ecbbfed None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:39.183251 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3942305-56ce-4d2d-b0f6-3ed51ecbbfed None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:39.184647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3942305-56ce-4d2d-b0f6-3ed51ecbbfed None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:39.186724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3942305-56ce-4d2d-b0f6-3ed51ecbbfed None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:39.188832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 216/428] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:38 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:39.194782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3942305-56ce-4d2d-b0f6-3ed51ecbbfed None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:39.207890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324aac-4036-4787-852b-ffa446046d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:39.208795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324aac-4036-4787-852b-ffa446046d8f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:39.209085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324aac-4036-4787-852b-ffa446046d8f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:39.209371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324aac-4036-4787-852b-ffa446046d8f None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:39.210694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324aac-4036-4787-852b-ffa446046d8f None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:39.212366 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324aac-4036-4787-852b-ffa446046d8f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:39.214374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 213/429] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:38 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:39.220817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324aac-4036-4787-852b-ffa446046d8f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:39.332607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3942305-56ce-4d2d-b0f6-3ed51ecbbfed None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:39.392595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa58481-93d0-47fc-ad8b-ae334b097815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:39.393274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa58481-93d0-47fc-ad8b-ae334b097815 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:39.393552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa58481-93d0-47fc-ad8b-ae334b097815 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:39.393822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa58481-93d0-47fc-ad8b-ae334b097815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:39.394662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa58481-93d0-47fc-ad8b-ae334b097815 None admin] RBAC: Adding query filter params (group.id=21011426bf0e4cbd9ab8a1f49c712b87, role.id=2d441060f04441848c895dc5b9affb06, scope.project.id=540bf727f064487c930910ee34bc6da0) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:39.394971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa58481-93d0-47fc-ad8b-ae334b097815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:39.396707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa58481-93d0-47fc-ad8b-ae334b097815 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:39.402485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324aac-4036-4787-852b-ffa446046d8f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:39.403286 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 217/430] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 12 14:17:39 2022] GET /identity/v3/role_assignments?group.id=21011426bf0e4cbd9ab8a1f49c712b87&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=2d441060f04441848c895dc5b9affb06 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:39.405216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7741495-db55-46b6-9bf4-214dec23d5c5 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:39.405405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7741495-db55-46b6-9bf4-214dec23d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:39.405640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7741495-db55-46b6-9bf4-214dec23d5c5 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:39.407485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 218/431] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:39.415971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616065-c937-4472-9164-cd63d4e7d9f3 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:39.416275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616065-c937-4472-9164-cd63d4e7d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:39.416527 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c616065-c937-4472-9164-cd63d4e7d9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:39.454284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ab746-d4d3-48cf-ae42-f31274575c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:39.455502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ab746-d4d3-48cf-ae42-f31274575c1c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:39.456013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ab746-d4d3-48cf-ae42-f31274575c1c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:39.456491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ab746-d4d3-48cf-ae42-f31274575c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:39.457543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ab746-d4d3-48cf-ae42-f31274575c1c None admin] RBAC: Adding query filter params (group.id=21011426bf0e4cbd9ab8a1f49c712b87, role.id=8b437ce0fad84637a68c6c151d4e2c5c, scope.project.id=540bf727f064487c930910ee34bc6da0) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:39.458081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ab746-d4d3-48cf-ae42-f31274575c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:39.459269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-9c616065-c937-4472-9164-cd63d4e7d9f3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:39.460196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ab746-d4d3-48cf-ae42-f31274575c1c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:39.460480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9c616065-c937-4472-9164-cd63d4e7d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:39.469687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 214/432] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 12 14:17:39 2022] GET /identity/v3/role_assignments?group.id=21011426bf0e4cbd9ab8a1f49c712b87&scope.project.id=540bf727f064487c930910ee34bc6da0&role.id=8b437ce0fad84637a68c6c151d4e2c5c => generated 611 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:39.592891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 219/433] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:39.631785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ab746-d4d3-48cf-ae42-f31274575c1c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:39.775789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ab746-d4d3-48cf-ae42-f31274575c1c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:39.819494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d272ed2-4c82-4442-ac93-ac008f7a91e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:39.820307 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272ed2-4c82-4442-ac93-ac008f7a91e2 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:39.820596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272ed2-4c82-4442-ac93-ac008f7a91e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:39.820876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d272ed2-4c82-4442-ac93-ac008f7a91e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:39.834092 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d272ed2-4c82-4442-ac93-ac008f7a91e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-9d272ed2-4c82-4442-ac93-ac008f7a91e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:39.842392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:39.843370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:39.844161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 215/434] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:39.850196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616065-c937-4472-9164-cd63d4e7d9f3 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:39.963085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc169-e7e3-4ed1-bd97-eeec4c84f998 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:39.963085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc169-e7e3-4ed1-bd97-eeec4c84f998 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:39.963085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc169-e7e3-4ed1-bd97-eeec4c84f998 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:39.964558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 216/435] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:39.970084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c616065-c937-4472-9164-cd63d4e7d9f3 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:39.970822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552099f-80f1-410a-b623-fef256f2d6bc None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:39.971149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552099f-80f1-410a-b623-fef256f2d6bc None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:39.971430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552099f-80f1-410a-b623-fef256f2d6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:39.992422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6552099f-80f1-410a-b623-fef256f2d6bc None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:39.994028 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6552099f-80f1-410a-b623-fef256f2d6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:40.011127 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a63316-a6a3-4d26-a040-a4fcd8231652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:40.012162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a63316-a6a3-4d26-a040-a4fcd8231652 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:40.012669 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a63316-a6a3-4d26-a040-a4fcd8231652 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:40.013142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a63316-a6a3-4d26-a040-a4fcd8231652 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:40.014657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a63316-a6a3-4d26-a040-a4fcd8231652 None admin] RBAC: Adding query filter params (name=member) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:40.015212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a63316-a6a3-4d26-a040-a4fcd8231652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:40.016632 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a63316-a6a3-4d26-a040-a4fcd8231652 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:40.025721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 220/436] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:17:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:40.032875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a63316-a6a3-4d26-a040-a4fcd8231652 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:40.082481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 217/437] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:40.108690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552099f-80f1-410a-b623-fef256f2d6bc None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:40.157066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a63316-a6a3-4d26-a040-a4fcd8231652 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:40.197508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe6221-c708-44f4-acbf-7970b58eb4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:40.198175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe6221-c708-44f4-acbf-7970b58eb4fa None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:40.198459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe6221-c708-44f4-acbf-7970b58eb4fa None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:40.198738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe6221-c708-44f4-acbf-7970b58eb4fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:40.235962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552099f-80f1-410a-b623-fef256f2d6bc None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:40.281624 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198b5c-877c-4dd9-8be1-fd252dad6f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:40.282716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198b5c-877c-4dd9-8be1-fd252dad6f19 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:40.283076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198b5c-877c-4dd9-8be1-fd252dad6f19 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:40.283317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77198b5c-877c-4dd9-8be1-fd252dad6f19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:40.289971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe6221-c708-44f4-acbf-7970b58eb4fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:40.291291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe6221-c708-44f4-acbf-7970b58eb4fa None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:40.297921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77198b5c-877c-4dd9-8be1-fd252dad6f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-77198b5c-877c-4dd9-8be1-fd252dad6f19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:40.306500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:40.307521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:40.308310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 218/438] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:40.313873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198b5c-877c-4dd9-8be1-fd252dad6f19 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:40.400173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 221/439] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:17:40.406101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe6221-c708-44f4-acbf-7970b58eb4fa None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:40.421309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77198b5c-877c-4dd9-8be1-fd252dad6f19 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:40.455071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cb8bb-2711-4d0f-8b19-5f4ee9f8dfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:40.455819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cb8bb-2711-4d0f-8b19-5f4ee9f8dfce None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:40.456103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cb8bb-2711-4d0f-8b19-5f4ee9f8dfce None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:40.456379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cb8bb-2711-4d0f-8b19-5f4ee9f8dfce None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:40.457130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cb8bb-2711-4d0f-8b19-5f4ee9f8dfce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:40.457434 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cb8bb-2711-4d0f-8b19-5f4ee9f8dfce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:40.458820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cb8bb-2711-4d0f-8b19-5f4ee9f8dfce None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:40.467352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 219/440] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:40.473141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cb8bb-2711-4d0f-8b19-5f4ee9f8dfce None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:40.515484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe6221-c708-44f4-acbf-7970b58eb4fa None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:40.551593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad8d3e-3135-4962-b2fa-e027c09ed7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:40.552375 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad8d3e-3135-4962-b2fa-e027c09ed7fd None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:40.552658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad8d3e-3135-4962-b2fa-e027c09ed7fd None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:40.552936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad8d3e-3135-4962-b2fa-e027c09ed7fd None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:40.554178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad8d3e-3135-4962-b2fa-e027c09ed7fd None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:40.555655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad8d3e-3135-4962-b2fa-e027c09ed7fd None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:40.557650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 222/441] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:40 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:40.562747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad8d3e-3135-4962-b2fa-e027c09ed7fd None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:40.580226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cb8bb-2711-4d0f-8b19-5f4ee9f8dfce None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:40.612782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12895f39-db41-43e1-8160-6a264bbc211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:40.613438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12895f39-db41-43e1-8160-6a264bbc211a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:40.613721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12895f39-db41-43e1-8160-6a264bbc211a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:40.614002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12895f39-db41-43e1-8160-6a264bbc211a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:40.657906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad8d3e-3135-4962-b2fa-e027c09ed7fd None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:40.679161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12895f39-db41-43e1-8160-6a264bbc211a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:40.680654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12895f39-db41-43e1-8160-6a264bbc211a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:40.689555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9138eed-9fae-45e3-b52f-5f4338360cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:40.690405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9138eed-9fae-45e3-b52f-5f4338360cc4 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:40.690692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9138eed-9fae-45e3-b52f-5f4338360cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:40.690970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9138eed-9fae-45e3-b52f-5f4338360cc4 None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:40.692185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9138eed-9fae-45e3-b52f-5f4338360cc4 None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:40.693607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9138eed-9fae-45e3-b52f-5f4338360cc4 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:40.695247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 223/442] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:40 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:40.696565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37aa6-aefa-46cf-8f8b-f414b7dca270 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:40.696862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37aa6-aefa-46cf-8f8b-f414b7dca270 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:40.697140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b37aa6-aefa-46cf-8f8b-f414b7dca270 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:40.698478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 224/443] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:40.700972 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b37aa6-aefa-46cf-8f8b-f414b7dca270 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:40.779002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 220/444] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:40.780850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322492e-872d-4d2f-b332-875740045aab None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:40.780850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322492e-872d-4d2f-b332-875740045aab None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:40.781033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322492e-872d-4d2f-b332-875740045aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:40.796917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-2322492e-872d-4d2f-b332-875740045aab None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:40.798084 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2322492e-872d-4d2f-b332-875740045aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:40.800522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b37aa6-aefa-46cf-8f8b-f414b7dca270 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:40.834337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7665b7c-18ee-4d87-bbad-c8c86a715778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:40.835009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7665b7c-18ee-4d87-bbad-c8c86a715778 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:40.835325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7665b7c-18ee-4d87-bbad-c8c86a715778 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:40.835605 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7665b7c-18ee-4d87-bbad-c8c86a715778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:40.836455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7665b7c-18ee-4d87-bbad-c8c86a715778 None admin] RBAC: Adding query filter params (group.id=21011426bf0e4cbd9ab8a1f49c712b87, role.id=2d441060f04441848c895dc5b9affb06, scope.project.id=4a5e849b81e744c08ab224f1f42af588) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:40.836772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7665b7c-18ee-4d87-bbad-c8c86a715778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:40.838230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7665b7c-18ee-4d87-bbad-c8c86a715778 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:40.844619 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 225/445] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 12 14:17:40 2022] GET /identity/v3/role_assignments?group.id=21011426bf0e4cbd9ab8a1f49c712b87&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=2d441060f04441848c895dc5b9affb06 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:40.845450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7665b7c-18ee-4d87-bbad-c8c86a715778 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:40.879063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 221/446] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:40.899584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322492e-872d-4d2f-b332-875740045aab None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:40.978422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7665b7c-18ee-4d87-bbad-c8c86a715778 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:41.009928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322492e-872d-4d2f-b332-875740045aab None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:41.012917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e69529-8460-416e-ab03-5cebb0d0af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:41.014059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e69529-8460-416e-ab03-5cebb0d0af97 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:41.015410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e69529-8460-416e-ab03-5cebb0d0af97 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:41.015410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e69529-8460-416e-ab03-5cebb0d0af97 None admin] PATH_INFO: `/v3/projects/4a5e849b81e744c08ab224f1f42af588` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:41.015958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e69529-8460-416e-ab03-5cebb0d0af97 None admin] RBAC: Authorizing `identity:get_project(project_id=4a5e849b81e744c08ab224f1f42af588)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:41.017483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e69529-8460-416e-ab03-5cebb0d0af97 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:41.019442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 226/447] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:40 2022] GET /identity/v3/projects/4a5e849b81e744c08ab224f1f42af588 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:41.025149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e69529-8460-416e-ab03-5cebb0d0af97 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:41.052050 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f34753-03fc-4fff-9e7d-087dd7ebe635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:41.053090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f34753-03fc-4fff-9e7d-087dd7ebe635 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:41.053524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f34753-03fc-4fff-9e7d-087dd7ebe635 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:41.053978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f34753-03fc-4fff-9e7d-087dd7ebe635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:41.065736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f34753-03fc-4fff-9e7d-087dd7ebe635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-d7f34753-03fc-4fff-9e7d-087dd7ebe635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:41.073581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:41.074671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:41.075538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 222/448] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:17:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:41.082990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f34753-03fc-4fff-9e7d-087dd7ebe635 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:41.156484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e69529-8460-416e-ab03-5cebb0d0af97 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:41.199590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c4922-d699-4c2b-b784-7ec7a63428d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:41.200472 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c4922-d699-4c2b-b784-7ec7a63428d8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:41.200755 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c4922-d699-4c2b-b784-7ec7a63428d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:41.201032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c4922-d699-4c2b-b784-7ec7a63428d8 None admin] PATH_INFO: `/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:41.203844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c4922-d699-4c2b-b784-7ec7a63428d8 None admin] RBAC: Authorizing `identity:get_group(group_id=21011426bf0e4cbd9ab8a1f49c712b87)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:41.205652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c4922-d699-4c2b-b784-7ec7a63428d8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:41.207500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 227/449] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:41 2022] GET /identity/v3/groups/21011426bf0e4cbd9ab8a1f49c712b87 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:41.213332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c4922-d699-4c2b-b784-7ec7a63428d8 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:41.217052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f34753-03fc-4fff-9e7d-087dd7ebe635 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:41.257514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e8be3-1385-4444-a478-8248965fd107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:41.258187 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8be3-1385-4444-a478-8248965fd107 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:41.258466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8be3-1385-4444-a478-8248965fd107 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:41.258739 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e8be3-1385-4444-a478-8248965fd107 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:41.259966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e8be3-1385-4444-a478-8248965fd107 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:41.259966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e8be3-1385-4444-a478-8248965fd107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:41.261396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e8be3-1385-4444-a478-8248965fd107 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:41.270203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 223/450] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:41.276616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e8be3-1385-4444-a478-8248965fd107 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:41.323238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c4922-d699-4c2b-b784-7ec7a63428d8 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:41.354899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad6a3-a4a7-4214-aa90-78ea8ea66ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:41.355583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad6a3-a4a7-4214-aa90-78ea8ea66ced None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:41.355873 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad6a3-a4a7-4214-aa90-78ea8ea66ced None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:41.356142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad6a3-a4a7-4214-aa90-78ea8ea66ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:41.356984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad6a3-a4a7-4214-aa90-78ea8ea66ced None admin] RBAC: Adding query filter params (group.id=21011426bf0e4cbd9ab8a1f49c712b87, role.id=8b437ce0fad84637a68c6c151d4e2c5c, scope.project.id=4a5e849b81e744c08ab224f1f42af588) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:41.357298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad6a3-a4a7-4214-aa90-78ea8ea66ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:41.359292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad6a3-a4a7-4214-aa90-78ea8ea66ced None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:41.365819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 228/451] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 12 14:17:41 2022] GET /identity/v3/role_assignments?group.id=21011426bf0e4cbd9ab8a1f49c712b87&scope.project.id=4a5e849b81e744c08ab224f1f42af588&role.id=8b437ce0fad84637a68c6c151d4e2c5c => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:41.378798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e8be3-1385-4444-a478-8248965fd107 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:41.418480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16076c5a-40bf-42c4-87ef-357df82c527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:41.419087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076c5a-40bf-42c4-87ef-357df82c527a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:41.419372 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076c5a-40bf-42c4-87ef-357df82c527a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:41.419648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16076c5a-40bf-42c4-87ef-357df82c527a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:41.491302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16076c5a-40bf-42c4-87ef-357df82c527a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:41.492787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16076c5a-40bf-42c4-87ef-357df82c527a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:41.594908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 224/452] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:17:41.600585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad6a3-a4a7-4214-aa90-78ea8ea66ced None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:41.704865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad6a3-a4a7-4214-aa90-78ea8ea66ced None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:41.738081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e64dd-ac94-45c5-9c17-671f8b984bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:41.738952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e64dd-ac94-45c5-9c17-671f8b984bea None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:41.739266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e64dd-ac94-45c5-9c17-671f8b984bea None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:41.739542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e64dd-ac94-45c5-9c17-671f8b984bea None admin] PATH_INFO: `/v3/projects/b51fa73b4d054aee9ce299da7ce9ee7a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:41.740754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e64dd-ac94-45c5-9c17-671f8b984bea None admin] RBAC: Authorizing `identity:get_project(project_id=b51fa73b4d054aee9ce299da7ce9ee7a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:41.742198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e64dd-ac94-45c5-9c17-671f8b984bea None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:41.743905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 229/453] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:17:41 2022] GET /identity/v3/projects/b51fa73b4d054aee9ce299da7ce9ee7a => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:41.749479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16076c5a-40bf-42c4-87ef-357df82c527a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:41.847924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16076c5a-40bf-42c4-87ef-357df82c527a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:41.880383 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46047e4-6927-4c7b-9b1c-ed2d3922f2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:41.881232 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46047e4-6927-4c7b-9b1c-ed2d3922f2c2 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:41.881516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46047e4-6927-4c7b-9b1c-ed2d3922f2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:41.881794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46047e4-6927-4c7b-9b1c-ed2d3922f2c2 None admin] PATH_INFO: `/v3/groups/b4e04361145b45f5a883ac16a3d7f16b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:41.882975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46047e4-6927-4c7b-9b1c-ed2d3922f2c2 None admin] RBAC: Authorizing `identity:get_group(group_id=b4e04361145b45f5a883ac16a3d7f16b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:41.884463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46047e4-6927-4c7b-9b1c-ed2d3922f2c2 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:41.886081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 225/454] 10.222.0.75 () {56 vars in 1180 bytes} [Thu May 12 14:17:41 2022] GET /identity/v3/groups/b4e04361145b45f5a883ac16a3d7f16b => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:41.891880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e64dd-ac94-45c5-9c17-671f8b984bea None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:41.988061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e64dd-ac94-45c5-9c17-671f8b984bea None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:42.020790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23a4de-057a-4b21-b7d2-67cb00f19113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:42.021704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23a4de-057a-4b21-b7d2-67cb00f19113 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:42.021982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23a4de-057a-4b21-b7d2-67cb00f19113 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:42.022257 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23a4de-057a-4b21-b7d2-67cb00f19113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:42.023234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23a4de-057a-4b21-b7d2-67cb00f19113 None admin] RBAC: Adding query filter params (group.id=b4e04361145b45f5a883ac16a3d7f16b, role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=b51fa73b4d054aee9ce299da7ce9ee7a) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:42.023418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23a4de-057a-4b21-b7d2-67cb00f19113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:42.024842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23a4de-057a-4b21-b7d2-67cb00f19113 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:42.031189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 230/455] 10.222.0.75 () {56 vars in 1376 bytes} [Thu May 12 14:17:41 2022] GET /identity/v3/role_assignments?group.id=b4e04361145b45f5a883ac16a3d7f16b&scope.project.id=b51fa73b4d054aee9ce299da7ce9ee7a&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:44.866523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0d11a-8e38-4351-9a77-d9344862babe None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:44.867591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0d11a-8e38-4351-9a77-d9344862babe None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:44.868081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0d11a-8e38-4351-9a77-d9344862babe None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:44.869917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 226/456] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:44.875323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e0a59-57e1-4822-b7ca-cb2783b6150d None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:44.876206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e0a59-57e1-4822-b7ca-cb2783b6150d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:44.876711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e0a59-57e1-4822-b7ca-cb2783b6150d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:44.900951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-180e0a59-57e1-4822-b7ca-cb2783b6150d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:44.902568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-180e0a59-57e1-4822-b7ca-cb2783b6150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:45.014846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 231/457] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:45.083633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733038-f0bd-4cb8-b47b-fb3cb6f8ba8e None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.084266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733038-f0bd-4cb8-b47b-fb3cb6f8ba8e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.084753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf733038-f0bd-4cb8-b47b-fb3cb6f8ba8e None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.086596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 227/458] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:45.087892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e0a59-57e1-4822-b7ca-cb2783b6150d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:45.092509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cefcf-b9d8-49e1-9aa7-30d301b4dd5c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.092995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cefcf-b9d8-49e1-9aa7-30d301b4dd5c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.093708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cefcf-b9d8-49e1-9aa7-30d301b4dd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.144686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e94cefcf-b9d8-49e1-9aa7-30d301b4dd5c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:45.146420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e94cefcf-b9d8-49e1-9aa7-30d301b4dd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:45.193838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e0a59-57e1-4822-b7ca-cb2783b6150d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:45.235476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74288ca-acde-4077-bc5a-760eb4c9d93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:45.236298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74288ca-acde-4077-bc5a-760eb4c9d93f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.236583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74288ca-acde-4077-bc5a-760eb4c9d93f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.236855 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74288ca-acde-4077-bc5a-760eb4c9d93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.259657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74288ca-acde-4077-bc5a-760eb4c9d93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:45.261169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74288ca-acde-4077-bc5a-760eb4c9d93f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:45.282924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 228/459] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-c74288ca-acde-4077-bc5a-760eb4c9d93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:45.292144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:45.293109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:45.294660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:45.294660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:45.294660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:45.294660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:45.294660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 232/460] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:45.300003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cefcf-b9d8-49e1-9aa7-30d301b4dd5c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:45.318314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61dc67-daa6-4bc1-9d4b-21def357af6d None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.318598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61dc67-daa6-4bc1-9d4b-21def357af6d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.318874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61dc67-daa6-4bc1-9d4b-21def357af6d None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.320671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 233/461] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:45.321453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61dc67-daa6-4bc1-9d4b-21def357af6d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:45.449690 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61dc67-daa6-4bc1-9d4b-21def357af6d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:45.461667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cefcf-b9d8-49e1-9aa7-30d301b4dd5c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:45.491471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cfa11-d224-4f45-a83b-74115da9a875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:45.492276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cfa11-d224-4f45-a83b-74115da9a875 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.492560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cfa11-d224-4f45-a83b-74115da9a875 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.492835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cfa11-d224-4f45-a83b-74115da9a875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.513012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e4f61-e778-4087-83da-25588a0a0b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:45.514331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4f61-e778-4087-83da-25588a0a0b70 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.514635 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4f61-e778-4087-83da-25588a0a0b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.514916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4f61-e778-4087-83da-25588a0a0b70 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.515749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e4f61-e778-4087-83da-25588a0a0b70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:45.516139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e4f61-e778-4087-83da-25588a0a0b70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:45.517065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cfa11-d224-4f45-a83b-74115da9a875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:45.517572 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e4f61-e778-4087-83da-25588a0a0b70 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:45.519871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cfa11-d224-4f45-a83b-74115da9a875 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:45.540091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 229/462] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:45.541535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027beb4-e493-43dc-a457-f474ecc3b3d3 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.541901 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027beb4-e493-43dc-a457-f474ecc3b3d3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.542184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027beb4-e493-43dc-a457-f474ecc3b3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.561861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-2027beb4-e493-43dc-a457-f474ecc3b3d3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-a44cfa11-d224-4f45-a83b-74115da9a875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:45.562065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:45.563016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:45.563954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:45.563954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:45.563954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:45.563954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:45.564174 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2027beb4-e493-43dc-a457-f474ecc3b3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:45.564877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 234/463] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:45.565967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cfa11-d224-4f45-a83b-74115da9a875 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:45.651919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 230/464] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:45.653371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69967e-134a-4096-8af5-c50ed85c54e9 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.654147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69967e-134a-4096-8af5-c50ed85c54e9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.654435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69967e-134a-4096-8af5-c50ed85c54e9 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.662335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 231/465] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:45.662335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69967e-134a-4096-8af5-c50ed85c54e9 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:45.750688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cfa11-d224-4f45-a83b-74115da9a875 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:45.798580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c2eb4-6b78-4d7c-b04b-3f94cecfda15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:45.799300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2eb4-6b78-4d7c-b04b-3f94cecfda15 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.799582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2eb4-6b78-4d7c-b04b-3f94cecfda15 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.799856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c2eb4-6b78-4d7c-b04b-3f94cecfda15 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.800578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c2eb4-6b78-4d7c-b04b-3f94cecfda15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:45.802030 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c2eb4-6b78-4d7c-b04b-3f94cecfda15 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:45.805562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69967e-134a-4096-8af5-c50ed85c54e9 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:45.823583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 235/466] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:17:45 2022] POST /identity/v3/users => generated 246 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:17:45.824747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b7b4e-5ad4-45fc-96d0-4e763ebb385d None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.825086 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b7b4e-5ad4-45fc-96d0-4e763ebb385d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.825448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b7b4e-5ad4-45fc-96d0-4e763ebb385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.843641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-f69b7b4e-5ad4-45fc-96d0-4e763ebb385d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:45.844960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f69b7b4e-5ad4-45fc-96d0-4e763ebb385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:45.857128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df23ef4-3c78-411d-af81-63c3a3a9fd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:45.859423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df23ef4-3c78-411d-af81-63c3a3a9fd58 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:45.860279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df23ef4-3c78-411d-af81-63c3a3a9fd58 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:45.860776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df23ef4-3c78-411d-af81-63c3a3a9fd58 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:45.862086 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df23ef4-3c78-411d-af81-63c3a3a9fd58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:45.863223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df23ef4-3c78-411d-af81-63c3a3a9fd58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:45.865578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df23ef4-3c78-411d-af81-63c3a3a9fd58 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:45.883856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 232/467] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:45.885591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df23ef4-3c78-411d-af81-63c3a3a9fd58 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:45.928136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 236/468] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:45.939099 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b7b4e-5ad4-45fc-96d0-4e763ebb385d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:46.028876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df23ef4-3c78-411d-af81-63c3a3a9fd58 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:46.072873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481408e1-7852-4e84-9467-1c134b9bc818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:46.075467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481408e1-7852-4e84-9467-1c134b9bc818 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:46.075467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481408e1-7852-4e84-9467-1c134b9bc818 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:46.075467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481408e1-7852-4e84-9467-1c134b9bc818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:46.084132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b7b4e-5ad4-45fc-96d0-4e763ebb385d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:46.089796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481408e1-7852-4e84-9467-1c134b9bc818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:46.091978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481408e1-7852-4e84-9467-1c134b9bc818 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-481408e1-7852-4e84-9467-1c134b9bc818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:46.114612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:46.115638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:46.116490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:46.116490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:46.116490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:46.116490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:46.116490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 233/469] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:46.116767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481408e1-7852-4e84-9467-1c134b9bc818 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:46.134949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187ac9-fc8f-4434-aa9d-28dc1b636be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:46.135745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187ac9-fc8f-4434-aa9d-28dc1b636be1 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:46.136018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187ac9-fc8f-4434-aa9d-28dc1b636be1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:46.136522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187ac9-fc8f-4434-aa9d-28dc1b636be1 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:46.136992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c187ac9-fc8f-4434-aa9d-28dc1b636be1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:46.138461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c187ac9-fc8f-4434-aa9d-28dc1b636be1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:46.162467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 237/470] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:17:45 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:17:46.163774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187ac9-fc8f-4434-aa9d-28dc1b636be1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:46.267564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481408e1-7852-4e84-9467-1c134b9bc818 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:46.287899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187ac9-fc8f-4434-aa9d-28dc1b636be1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:46.317335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7725fa-5a77-4dfa-87f5-d34e81244abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:46.318944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7725fa-5a77-4dfa-87f5-d34e81244abd None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:46.319527 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7725fa-5a77-4dfa-87f5-d34e81244abd None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:46.320024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7725fa-5a77-4dfa-87f5-d34e81244abd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:46.328155 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729bb00-b892-44cc-92a0-e6066f2573d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:46.328851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729bb00-b892-44cc-92a0-e6066f2573d1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:46.329266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729bb00-b892-44cc-92a0-e6066f2573d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:46.329952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729bb00-b892-44cc-92a0-e6066f2573d1 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:46.330455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729bb00-b892-44cc-92a0-e6066f2573d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:46.330773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729bb00-b892-44cc-92a0-e6066f2573d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:46.332297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729bb00-b892-44cc-92a0-e6066f2573d1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:46.335101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7725fa-5a77-4dfa-87f5-d34e81244abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:46.336943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7725fa-5a77-4dfa-87f5-d34e81244abd None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:46.346360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 238/471] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:46.351719 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729bb00-b892-44cc-92a0-e6066f2573d1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-6b7725fa-5a77-4dfa-87f5-d34e81244abd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:46.356929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:46.357844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:46.358767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:46.358767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:46.358767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:46.358767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:46.360752 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 234/472] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:46.368074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7725fa-5a77-4dfa-87f5-d34e81244abd None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:46.479802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729bb00-b892-44cc-92a0-e6066f2573d1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:46.501232 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7725fa-5a77-4dfa-87f5-d34e81244abd None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:46.538768 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbe793-bb6c-466b-8c73-13abd66e646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:46.539184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e696f-a4dd-45f9-b15b-42bc80aefcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:46.539432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbe793-bb6c-466b-8c73-13abd66e646a None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:46.539701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbe793-bb6c-466b-8c73-13abd66e646a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:46.539940 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbe793-bb6c-466b-8c73-13abd66e646a None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:46.540670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbe793-bb6c-466b-8c73-13abd66e646a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:46.541643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e696f-a4dd-45f9-b15b-42bc80aefcd5 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:46.542126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbe793-bb6c-466b-8c73-13abd66e646a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:46.542339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e696f-a4dd-45f9-b15b-42bc80aefcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:46.542803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e696f-a4dd-45f9-b15b-42bc80aefcd5 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:46.545292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e696f-a4dd-45f9-b15b-42bc80aefcd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:46.545611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e696f-a4dd-45f9-b15b-42bc80aefcd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:46.547171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e696f-a4dd-45f9-b15b-42bc80aefcd5 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:46.563980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 235/473] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:46.565348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca2e9b-a074-48af-9e33-82b9f2be22b8 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:46.565632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca2e9b-a074-48af-9e33-82b9f2be22b8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:46.565907 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca2e9b-a074-48af-9e33-82b9f2be22b8 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:46.571617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 239/474] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:17:46 2022] POST /identity/v3/users => generated 248 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:17:46.571805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 236/475] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:46.573198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbe793-bb6c-466b-8c73-13abd66e646a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:46.578513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d63f9-83ff-4cac-92c2-80e30a504777 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:46.578804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d63f9-83ff-4cac-92c2-80e30a504777 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:46.579131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d63f9-83ff-4cac-92c2-80e30a504777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:46.606569 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-1d5d63f9-83ff-4cac-92c2-80e30a504777 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:46.608406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1d5d63f9-83ff-4cac-92c2-80e30a504777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:46.696381 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 237/476] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:46.719551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d63f9-83ff-4cac-92c2-80e30a504777 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:46.731954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbe793-bb6c-466b-8c73-13abd66e646a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:46.778036 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a1ad9-152b-40bb-b0fc-ad17fb5ff2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:46.778724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1ad9-152b-40bb-b0fc-ad17fb5ff2f9 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:46.779004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1ad9-152b-40bb-b0fc-ad17fb5ff2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:46.779353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1ad9-152b-40bb-b0fc-ad17fb5ff2f9 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:46.780065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a1ad9-152b-40bb-b0fc-ad17fb5ff2f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:46.781512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a1ad9-152b-40bb-b0fc-ad17fb5ff2f9 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:46.811202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 240/477] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:17:46 2022] POST /identity/v3/users => generated 249 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:17:46.851198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d63f9-83ff-4cac-92c2-80e30a504777 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:46.900908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6353f7-a536-455a-8937-cb0beffa9ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:46.901677 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6353f7-a536-455a-8937-cb0beffa9ed9 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:46.901866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6353f7-a536-455a-8937-cb0beffa9ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:46.902139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6353f7-a536-455a-8937-cb0beffa9ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:46.902885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6353f7-a536-455a-8937-cb0beffa9ed9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:46.904954 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6353f7-a536-455a-8937-cb0beffa9ed9 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:46.922044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.sql.core [None req-4f6353f7-a536-455a-8937-cb0beffa9ed9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 14:17:46.922044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 14:17:46.922044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [parameters: {'id': '0eb939f0855f4a958ac9e55fc4add793', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 14:17:46.922044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79923) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-4f6353f7-a536-455a-8937-cb0beffa9ed9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application conn.query(q) May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application result.read() May 12 14:17:46.942157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return ref.to_dict() May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:17:46.943114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application next(self.gen) May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application yield resource May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application next(self.gen) May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self.session.rollback() May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self.force_reraise() May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise self.value May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application session.commit() May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 14:17:46.944037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._prepare_impl() May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self.session.flush() May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._flush(objects) May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application compat.raise_( May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application flush_context.execute() May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rec.execute(self) May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 14:17:46.944887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:17:46.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application conn.query(q) May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application result.read() May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:17:46.946600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [parameters: {'id': '0eb939f0855f4a958ac9e55fc4add793', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:46.951662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 12 14:17:46.953673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:46.955773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 238/478] 10.222.0.75 () {60 vars in 1131 bytes} [Thu May 12 14:17:46 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:46.955909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a1ad9-152b-40bb-b0fc-ad17fb5ff2f9 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:47.071562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a1ad9-152b-40bb-b0fc-ad17fb5ff2f9 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:47.117725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7784ab-24fe-483b-8862-eaa68380f01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:47.118555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7784ab-24fe-483b-8862-eaa68380f01a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:47.118835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7784ab-24fe-483b-8862-eaa68380f01a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:47.119138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7784ab-24fe-483b-8862-eaa68380f01a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:47.131616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7784ab-24fe-483b-8862-eaa68380f01a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-ae7784ab-24fe-483b-8862-eaa68380f01a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:47.141488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:47.143707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:47.145624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 241/479] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:17:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:47.152399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6353f7-a536-455a-8937-cb0beffa9ed9 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:47.263485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6353f7-a536-455a-8937-cb0beffa9ed9 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:47.304090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d99178-d593-4cbd-a52d-aa3f483d32c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:47.304773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d99178-d593-4cbd-a52d-aa3f483d32c9 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:47.305051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d99178-d593-4cbd-a52d-aa3f483d32c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:47.305324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d99178-d593-4cbd-a52d-aa3f483d32c9 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:47.306087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d99178-d593-4cbd-a52d-aa3f483d32c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:47.306389 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d99178-d593-4cbd-a52d-aa3f483d32c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:47.308207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d99178-d593-4cbd-a52d-aa3f483d32c9 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:47.318800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 239/480] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:48.719334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adcd73-c752-4aea-8c7c-3e0e8f3c09ab None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:48.720055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adcd73-c752-4aea-8c7c-3e0e8f3c09ab None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:48.720055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adcd73-c752-4aea-8c7c-3e0e8f3c09ab None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:48.721694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 242/481] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:48.728244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e4baa-fa69-490d-814b-cbc1f75fbacc None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:48.728888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e4baa-fa69-490d-814b-cbc1f75fbacc None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:48.728888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e4baa-fa69-490d-814b-cbc1f75fbacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:48.756260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-779e4baa-fa69-490d-814b-cbc1f75fbacc None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:48.757489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-779e4baa-fa69-490d-814b-cbc1f75fbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:48.890879 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 240/482] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:48.949425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adcd73-c752-4aea-8c7c-3e0e8f3c09ab None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:49.088732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adcd73-c752-4aea-8c7c-3e0e8f3c09ab None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:49.134624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d159-4f62-4ec6-ba14-49f495a8ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:49.135502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d159-4f62-4ec6-ba14-49f495a8ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:49.135788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d159-4f62-4ec6-ba14-49f495a8ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:49.136064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d159-4f62-4ec6-ba14-49f495a8ecd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:49.149959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7d159-4f62-4ec6-ba14-49f495a8ecd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-c9b7d159-4f62-4ec6-ba14-49f495a8ecd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:49.158331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:49.160578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:49.162516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:49.164016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 243/483] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:17:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:49.172331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e4baa-fa69-490d-814b-cbc1f75fbacc None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:49.334636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e4baa-fa69-490d-814b-cbc1f75fbacc None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:49.392659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acdc83-db39-4ea6-9f7a-8fcbce9a5f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:49.393294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acdc83-db39-4ea6-9f7a-8fcbce9a5f96 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:49.393582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acdc83-db39-4ea6-9f7a-8fcbce9a5f96 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:49.393861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acdc83-db39-4ea6-9f7a-8fcbce9a5f96 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:49.394650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acdc83-db39-4ea6-9f7a-8fcbce9a5f96 None admin] RBAC: Adding query filter params (name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:49.394968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acdc83-db39-4ea6-9f7a-8fcbce9a5f96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:49.396693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acdc83-db39-4ea6-9f7a-8fcbce9a5f96 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:49.412216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 241/484] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:17:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:49.417489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d159-4f62-4ec6-ba14-49f495a8ecd2 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:49.559537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c48d-a3fe-444d-9b54-91fda921e3eb None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:49.560867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c48d-a3fe-444d-9b54-91fda921e3eb None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:49.561396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7c48d-a3fe-444d-9b54-91fda921e3eb None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:49.567378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 242/485] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:49.569113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb6709-b976-4da0-aeb1-160c40db4eb8 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:49.569621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb6709-b976-4da0-aeb1-160c40db4eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:49.570108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb6709-b976-4da0-aeb1-160c40db4eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:49.570236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d159-4f62-4ec6-ba14-49f495a8ecd2 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:49.587648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-10fb6709-b976-4da0-aeb1-160c40db4eb8 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:49.589226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-10fb6709-b976-4da0-aeb1-160c40db4eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:49.614632 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabcbcd-c88b-4e9a-8010-7fff938f3b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:49.620783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabcbcd-c88b-4e9a-8010-7fff938f3b87 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:49.622602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabcbcd-c88b-4e9a-8010-7fff938f3b87 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:49.623745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabcbcd-c88b-4e9a-8010-7fff938f3b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:49.637011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabcbcd-c88b-4e9a-8010-7fff938f3b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:49.639638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabcbcd-c88b-4e9a-8010-7fff938f3b87 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-4eabcbcd-c88b-4e9a-8010-7fff938f3b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:49.661792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:49.662670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:49.663585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:49.663585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:49.663585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:49.663585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:49.666002 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 244/486] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:49.672018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabcbcd-c88b-4e9a-8010-7fff938f3b87 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:49.737055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 243/487] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:49.753980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3143f1c-cebb-405d-a3d1-550503d5db66 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:49.754319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3143f1c-cebb-405d-a3d1-550503d5db66 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:49.754536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3143f1c-cebb-405d-a3d1-550503d5db66 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:49.756368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 244/488] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:49.762191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ff1e0-57c8-4f70-9eda-559f203bdbf7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:49.762720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ff1e0-57c8-4f70-9eda-559f203bdbf7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:49.763233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ff1e0-57c8-4f70-9eda-559f203bdbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:49.783007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-644ff1e0-57c8-4f70-9eda-559f203bdbf7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:49.784633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-644ff1e0-57c8-4f70-9eda-559f203bdbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:49.846991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabcbcd-c88b-4e9a-8010-7fff938f3b87 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:49.878513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 245/489] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:17:49.879917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ff1e0-57c8-4f70-9eda-559f203bdbf7 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:49.889869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cff155-0a97-4fce-aa72-88ba8b79a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:49.890783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cff155-0a97-4fce-aa72-88ba8b79a1b7 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:49.891318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cff155-0a97-4fce-aa72-88ba8b79a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:49.891996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cff155-0a97-4fce-aa72-88ba8b79a1b7 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:49.893550 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cff155-0a97-4fce-aa72-88ba8b79a1b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:49.894091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cff155-0a97-4fce-aa72-88ba8b79a1b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:49.895832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cff155-0a97-4fce-aa72-88ba8b79a1b7 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:49.910699 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 245/490] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:49.916153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cff155-0a97-4fce-aa72-88ba8b79a1b7 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:50.019222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ff1e0-57c8-4f70-9eda-559f203bdbf7 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:50.038373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cff155-0a97-4fce-aa72-88ba8b79a1b7 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:50.067902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94269-24c9-478a-a68a-7a425b2799aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:50.069589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94269-24c9-478a-a68a-7a425b2799aa None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.070269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94269-24c9-478a-a68a-7a425b2799aa None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.070730 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f94269-24c9-478a-a68a-7a425b2799aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.075880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ecfca-c7a0-4c73-998a-2ad7abb0529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:50.076818 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ecfca-c7a0-4c73-998a-2ad7abb0529e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.077100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ecfca-c7a0-4c73-998a-2ad7abb0529e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.077384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ecfca-c7a0-4c73-998a-2ad7abb0529e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.086292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f94269-24c9-478a-a68a-7a425b2799aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:50.088919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ecfca-c7a0-4c73-998a-2ad7abb0529e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c9f94269-24c9-478a-a68a-7a425b2799aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:50.095225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:50.096370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:50.097190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-846ecfca-c7a0-4c73-998a-2ad7abb0529e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:50.107974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:50.108789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:50.109590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:50.110201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 246/491] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:17:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:50.110268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 246/492] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:17:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:50.110341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94269-24c9-478a-a68a-7a425b2799aa None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:50.110418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e5a48-4ef1-47a4-8a52-a7eabf5de0ba None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.110418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e5a48-4ef1-47a4-8a52-a7eabf5de0ba None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.110418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e5a48-4ef1-47a4-8a52-a7eabf5de0ba None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.110418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 247/493] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:50.110418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e5a48-4ef1-47a4-8a52-a7eabf5de0ba None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:50.215186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f94269-24c9-478a-a68a-7a425b2799aa None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:50.224535 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e5a48-4ef1-47a4-8a52-a7eabf5de0ba None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:50.252992 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a9c22-911b-4532-837c-b38f254543d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:50.253798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a9c22-911b-4532-837c-b38f254543d5 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.254088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a9c22-911b-4532-837c-b38f254543d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.254371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a9c22-911b-4532-837c-b38f254543d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.262722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a9c22-911b-4532-837c-b38f254543d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:50.264314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a9c22-911b-4532-837c-b38f254543d5 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:50.268617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01461f19-793d-41ff-b6a3-d244e52b7f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:50.270008 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461f19-793d-41ff-b6a3-d244e52b7f6a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.270532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461f19-793d-41ff-b6a3-d244e52b7f6a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.270940 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461f19-793d-41ff-b6a3-d244e52b7f6a None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.275281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01461f19-793d-41ff-b6a3-d244e52b7f6a None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:50.275281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01461f19-793d-41ff-b6a3-d244e52b7f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:50.275281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01461f19-793d-41ff-b6a3-d244e52b7f6a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:50.282644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 248/494] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:50.284476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73e67-565f-499a-9943-867d5e23c7a5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.284979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73e67-565f-499a-9943-867d5e23c7a5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.285459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e73e67-565f-499a-9943-867d5e23c7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-b18a9c22-911b-4532-837c-b38f254543d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:17:50.288142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:50.289060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:50.289973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:50.289973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:50.289973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:17:50.289973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:17:50.289973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:17:50.289973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:17:50.289973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:17:50.289973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:17:50.289973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:17:50.289973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:50.290502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 247/495] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 12 14:17:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:50.296277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a9c22-911b-4532-837c-b38f254543d5 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:50.306292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-99e73e67-565f-499a-9943-867d5e23c7a5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:50.307550 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-99e73e67-565f-499a-9943-867d5e23c7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:50.392077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 249/496] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:50.393285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e73e67-565f-499a-9943-867d5e23c7a5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:50.424162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a9c22-911b-4532-837c-b38f254543d5 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:50.458789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83ae07-d06c-4528-824b-6df91e3eaa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:50.459510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ae07-d06c-4528-824b-6df91e3eaa3d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.459797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ae07-d06c-4528-824b-6df91e3eaa3d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.460100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ae07-d06c-4528-824b-6df91e3eaa3d None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.460865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83ae07-d06c-4528-824b-6df91e3eaa3d None admin] RBAC: Adding query filter params (name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:50.461176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83ae07-d06c-4528-824b-6df91e3eaa3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:50.462600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83ae07-d06c-4528-824b-6df91e3eaa3d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:50.472078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 248/497] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:50.472881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83ae07-d06c-4528-824b-6df91e3eaa3d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:50.511826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e73e67-565f-499a-9943-867d5e23c7a5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:50.549088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838215c-ad3f-427a-9b47-efb3bbfc9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:50.549896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838215c-ad3f-427a-9b47-efb3bbfc9415 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.550173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838215c-ad3f-427a-9b47-efb3bbfc9415 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.550445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838215c-ad3f-427a-9b47-efb3bbfc9415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.561128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838215c-ad3f-427a-9b47-efb3bbfc9415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:50.562621 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838215c-ad3f-427a-9b47-efb3bbfc9415 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-2838215c-ad3f-427a-9b47-efb3bbfc9415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:50.581162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:50.582178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:50.583058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:50.583058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:50.583058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:50.583058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:50.583058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 250/498] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:50.583349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838215c-ad3f-427a-9b47-efb3bbfc9415 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:50.583415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83ae07-d06c-4528-824b-6df91e3eaa3d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:50.618593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b7205-7583-4834-a2f1-50431e03bc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:50.619322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7205-7583-4834-a2f1-50431e03bc15 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.619609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7205-7583-4834-a2f1-50431e03bc15 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.619886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b7205-7583-4834-a2f1-50431e03bc15 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.620744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b7205-7583-4834-a2f1-50431e03bc15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:50.621059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b7205-7583-4834-a2f1-50431e03bc15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:50.622531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b7205-7583-4834-a2f1-50431e03bc15 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:50.661636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 249/499] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 12 14:17:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:50.662498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b7205-7583-4834-a2f1-50431e03bc15 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:50.682730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838215c-ad3f-427a-9b47-efb3bbfc9415 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:50.723581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236c7ed-245d-4174-8c8f-e48ebfb14ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:50.724297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236c7ed-245d-4174-8c8f-e48ebfb14ae6 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.724581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236c7ed-245d-4174-8c8f-e48ebfb14ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.724853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236c7ed-245d-4174-8c8f-e48ebfb14ae6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.740633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236c7ed-245d-4174-8c8f-e48ebfb14ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-e236c7ed-245d-4174-8c8f-e48ebfb14ae6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:50.748687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:50.749979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:50.750924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 251/500] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:17:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:50.752232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0764f-74dd-4fd6-993d-f6770e4d1b27 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.752232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0764f-74dd-4fd6-993d-f6770e4d1b27 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.752232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0764f-74dd-4fd6-993d-f6770e4d1b27 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.753322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 252/501] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:50.758167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0764f-74dd-4fd6-993d-f6770e4d1b27 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:50.780006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b7205-7583-4834-a2f1-50431e03bc15 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:50.819364 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e672b30-f618-43c8-ba58-455236764b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:50.820183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672b30-f618-43c8-ba58-455236764b4d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.820464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672b30-f618-43c8-ba58-455236764b4d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.820736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e672b30-f618-43c8-ba58-455236764b4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.832249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e672b30-f618-43c8-ba58-455236764b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:50.833796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e672b30-f618-43c8-ba58-455236764b4d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-3e672b30-f618-43c8-ba58-455236764b4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:50.852780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:50.853753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:50.854604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:50.854604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:50.854604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:50.854604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:50.858896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 250/502] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:50.859724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e672b30-f618-43c8-ba58-455236764b4d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:50.881396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0764f-74dd-4fd6-993d-f6770e4d1b27 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:50.919307 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85936406-4e49-4d86-925c-16b2557f58b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:50.920414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85936406-4e49-4d86-925c-16b2557f58b0 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.920917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85936406-4e49-4d86-925c-16b2557f58b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.921417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85936406-4e49-4d86-925c-16b2557f58b0 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.922786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85936406-4e49-4d86-925c-16b2557f58b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:50.923439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85936406-4e49-4d86-925c-16b2557f58b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:50.926089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85936406-4e49-4d86-925c-16b2557f58b0 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:50.946784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 253/503] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:50.949192 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b69631-dce5-4246-a552-b0a00a901338 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:50.949669 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b69631-dce5-4246-a552-b0a00a901338 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:50.950106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b69631-dce5-4246-a552-b0a00a901338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:50.972710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-d5b69631-dce5-4246-a552-b0a00a901338 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:50.974019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d5b69631-dce5-4246-a552-b0a00a901338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:50.996309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e672b30-f618-43c8-ba58-455236764b4d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:51.033801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdbb25-6edd-481d-bf41-898e5afa0348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:51.034480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdbb25-6edd-481d-bf41-898e5afa0348 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:51.034771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdbb25-6edd-481d-bf41-898e5afa0348 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:51.035078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bdbb25-6edd-481d-bf41-898e5afa0348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:51.052948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 254/504] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:51.053832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b69631-dce5-4246-a552-b0a00a901338 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:51.106839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdbb25-6edd-481d-bf41-898e5afa0348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:51.108858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bdbb25-6edd-481d-bf41-898e5afa0348 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:51.169323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b69631-dce5-4246-a552-b0a00a901338 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:51.207721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 251/505] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:51.208606 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdbb25-6edd-481d-bf41-898e5afa0348 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:51.208800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf6f15-ec5c-4cef-b8d2-3de9ce3ae9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:51.209431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf6f15-ec5c-4cef-b8d2-3de9ce3ae9ca None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:51.209712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf6f15-ec5c-4cef-b8d2-3de9ce3ae9ca None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:51.209986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf6f15-ec5c-4cef-b8d2-3de9ce3ae9ca None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:51.210751 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf6f15-ec5c-4cef-b8d2-3de9ce3ae9ca None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:51.211082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf6f15-ec5c-4cef-b8d2-3de9ce3ae9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:51.212471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf6f15-ec5c-4cef-b8d2-3de9ce3ae9ca None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:51.221476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 255/506] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:51.222332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf6f15-ec5c-4cef-b8d2-3de9ce3ae9ca None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:51.315423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bdbb25-6edd-481d-bf41-898e5afa0348 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:51.331302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf6f15-ec5c-4cef-b8d2-3de9ce3ae9ca None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:51.355709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a039ae8-5d6e-499a-ba94-ff709bffe172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:51.356386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a039ae8-5d6e-499a-ba94-ff709bffe172 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:51.356670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a039ae8-5d6e-499a-ba94-ff709bffe172 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:51.356948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a039ae8-5d6e-499a-ba94-ff709bffe172 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:51.358327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a039ae8-5d6e-499a-ba94-ff709bffe172 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:51.358634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a039ae8-5d6e-499a-ba94-ff709bffe172 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:51.360110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a039ae8-5d6e-499a-ba94-ff709bffe172 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:51.370762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff60138-23ca-4fd5-9472-313fe17ab94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:51.371604 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff60138-23ca-4fd5-9472-313fe17ab94f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:51.371890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff60138-23ca-4fd5-9472-313fe17ab94f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:51.372135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 252/507] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:51.372232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff60138-23ca-4fd5-9472-313fe17ab94f None admin] PATH_INFO: `/v3/users/glance` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:51.373632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a039ae8-5d6e-499a-ba94-ff709bffe172 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:51.380989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff60138-23ca-4fd5-9472-313fe17ab94f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:51.382493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff60138-23ca-4fd5-9472-313fe17ab94f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-8ff60138-23ca-4fd5-9472-313fe17ab94f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:17:51.398870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:51.399943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:51.400862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 256/508] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:51.401463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff60138-23ca-4fd5-9472-313fe17ab94f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:51.478619 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a039ae8-5d6e-499a-ba94-ff709bffe172 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:51.507441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff60138-23ca-4fd5-9472-313fe17ab94f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:51.528124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caef282-ea8a-480b-89cc-fd2135d5cc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:51.530073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef282-ea8a-480b-89cc-fd2135d5cc9e None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:51.530575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef282-ea8a-480b-89cc-fd2135d5cc9e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:51.531108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caef282-ea8a-480b-89cc-fd2135d5cc9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:51.553897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caef282-ea8a-480b-89cc-fd2135d5cc9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:51.556562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caef282-ea8a-480b-89cc-fd2135d5cc9e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:51.571502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589777e-0c97-4879-97f3-ed4e5d14a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:51.572694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589777e-0c97-4879-97f3-ed4e5d14a773 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:51.572985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589777e-0c97-4879-97f3-ed4e5d14a773 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:51.573267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589777e-0c97-4879-97f3-ed4e5d14a773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-9caef282-ea8a-480b-89cc-fd2135d5cc9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:51.587423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:51.589025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:51.592199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:51.592199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:51.592199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:51.592199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:51.592199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 253/509] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:51.592199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caef282-ea8a-480b-89cc-fd2135d5cc9e None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:51.598942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589777e-0c97-4879-97f3-ed4e5d14a773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:51.600526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589777e-0c97-4879-97f3-ed4e5d14a773 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-2589777e-0c97-4879-97f3-ed4e5d14a773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:51.620397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:51.623341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:51.626009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:51.626009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:51.626009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:51.626009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:51.626009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 257/510] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:51.626009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589777e-0c97-4879-97f3-ed4e5d14a773 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:51.720412 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caef282-ea8a-480b-89cc-fd2135d5cc9e None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:51.746759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589777e-0c97-4879-97f3-ed4e5d14a773 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:51.765735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9742457-e1ee-40f4-8e0f-b7373c1987f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:51.766555 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9742457-e1ee-40f4-8e0f-b7373c1987f8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:51.766841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9742457-e1ee-40f4-8e0f-b7373c1987f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:51.767152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9742457-e1ee-40f4-8e0f-b7373c1987f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:51.780339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9742457-e1ee-40f4-8e0f-b7373c1987f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:51.781856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9742457-e1ee-40f4-8e0f-b7373c1987f8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:51.786470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c4320-5c2b-43e2-9cfa-9e7ff85be7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:51.787325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c4320-5c2b-43e2-9cfa-9e7ff85be7c7 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:51.787603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c4320-5c2b-43e2-9cfa-9e7ff85be7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:51.787871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c4320-5c2b-43e2-9cfa-9e7ff85be7c7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:51.796422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c4320-5c2b-43e2-9cfa-9e7ff85be7c7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:51.797904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c4320-5c2b-43e2-9cfa-9e7ff85be7c7 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-e9742457-e1ee-40f4-8e0f-b7373c1987f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:51.799682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:51.800520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:51.801374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:51.801374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:51.801374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:51.801374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:51.801374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 254/511] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:51.801960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9742457-e1ee-40f4-8e0f-b7373c1987f8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-065c4320-5c2b-43e2-9cfa-9e7ff85be7c7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:17:51.814895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:51.816870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 258/512] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:51.820845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c4320-5c2b-43e2-9cfa-9e7ff85be7c7 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:51.911921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9742457-e1ee-40f4-8e0f-b7373c1987f8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:51.934403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c4320-5c2b-43e2-9cfa-9e7ff85be7c7 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:51.946854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aef7c-e294-44c4-bbc8-b08dfc906b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:51.947580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aef7c-e294-44c4-bbc8-b08dfc906b86 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:51.947865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aef7c-e294-44c4-bbc8-b08dfc906b86 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:51.948140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aef7c-e294-44c4-bbc8-b08dfc906b86 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:51.948984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aef7c-e294-44c4-bbc8-b08dfc906b86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:51.949290 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aef7c-e294-44c4-bbc8-b08dfc906b86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:51.951373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aef7c-e294-44c4-bbc8-b08dfc906b86 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:51.973597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 255/513] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:51.975559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aef7c-e294-44c4-bbc8-b08dfc906b86 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:51.976685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34272b9-9477-40ae-8163-2ddd628197a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:51.977649 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34272b9-9477-40ae-8163-2ddd628197a8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:51.978065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34272b9-9477-40ae-8163-2ddd628197a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:51.978464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34272b9-9477-40ae-8163-2ddd628197a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:51.979601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34272b9-9477-40ae-8163-2ddd628197a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:51.980072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34272b9-9477-40ae-8163-2ddd628197a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:51.982254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34272b9-9477-40ae-8163-2ddd628197a8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:51.995446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 259/514] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:51.996292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34272b9-9477-40ae-8163-2ddd628197a8 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:52.081358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aef7c-e294-44c4-bbc8-b08dfc906b86 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:52.117402 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34272b9-9477-40ae-8163-2ddd628197a8 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:52.117742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ec89d-a2cf-47d1-8b22-6b4054e85280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:52.118423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ec89d-a2cf-47d1-8b22-6b4054e85280 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:52.118714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ec89d-a2cf-47d1-8b22-6b4054e85280 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:52.118988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ec89d-a2cf-47d1-8b22-6b4054e85280 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:52.119767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ec89d-a2cf-47d1-8b22-6b4054e85280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:52.120072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ec89d-a2cf-47d1-8b22-6b4054e85280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:52.121508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ec89d-a2cf-47d1-8b22-6b4054e85280 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:52.134335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 256/515] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:52.135236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ec89d-a2cf-47d1-8b22-6b4054e85280 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:52.173116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a363-f306-4ed8-b74c-01d19063fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:52.174063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a363-f306-4ed8-b74c-01d19063fc89 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:52.174495 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a363-f306-4ed8-b74c-01d19063fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:52.174922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a363-f306-4ed8-b74c-01d19063fc89 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:52.176178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a363-f306-4ed8-b74c-01d19063fc89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:52.176660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a363-f306-4ed8-b74c-01d19063fc89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:52.178967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a363-f306-4ed8-b74c-01d19063fc89 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:52.195492 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 260/516] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:52.196952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a363-f306-4ed8-b74c-01d19063fc89 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:52.261664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ec89d-a2cf-47d1-8b22-6b4054e85280 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:52.299571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612b810-0915-4f02-9759-fa7b9c54251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:52.300262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612b810-0915-4f02-9759-fa7b9c54251a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:52.300548 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612b810-0915-4f02-9759-fa7b9c54251a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:52.300825 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612b810-0915-4f02-9759-fa7b9c54251a None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:52.301687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612b810-0915-4f02-9759-fa7b9c54251a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:52.301998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612b810-0915-4f02-9759-fa7b9c54251a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:52.302900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a363-f306-4ed8-b74c-01d19063fc89 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:52.303503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612b810-0915-4f02-9759-fa7b9c54251a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:52.322047 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 257/517] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 12 14:17:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:52.322894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612b810-0915-4f02-9759-fa7b9c54251a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:52.343953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c63338-a788-4b79-a8d1-40cfea7636e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:52.344629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c63338-a788-4b79-a8d1-40cfea7636e4 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:52.344915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c63338-a788-4b79-a8d1-40cfea7636e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:52.345193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c63338-a788-4b79-a8d1-40cfea7636e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:52.429731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c63338-a788-4b79-a8d1-40cfea7636e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:52.431155 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c63338-a788-4b79-a8d1-40cfea7636e4 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:52.441515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612b810-0915-4f02-9759-fa7b9c54251a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:52.477128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87479fe-7854-4fed-902b-ed842a4ee1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:52.477816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87479fe-7854-4fed-902b-ed842a4ee1d6 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:52.478100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87479fe-7854-4fed-902b-ed842a4ee1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:52.478384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87479fe-7854-4fed-902b-ed842a4ee1d6 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:52.479144 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87479fe-7854-4fed-902b-ed842a4ee1d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:52.480638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87479fe-7854-4fed-902b-ed842a4ee1d6 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:52.501659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 258/518] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:17:52 2022] POST /identity/v3/users => generated 247 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:17:52.502513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87479fe-7854-4fed-902b-ed842a4ee1d6 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:52.541489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 261/519] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:52.542667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c63338-a788-4b79-a8d1-40cfea7636e4 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:52.639063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87479fe-7854-4fed-902b-ed842a4ee1d6 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:52.682695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b36d7-13cc-46d9-be6f-664c818f602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:52.683561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c63338-a788-4b79-a8d1-40cfea7636e4 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:52.683724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b36d7-13cc-46d9-be6f-664c818f602f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:52.684163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b36d7-13cc-46d9-be6f-664c818f602f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:52.684568 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b36d7-13cc-46d9-be6f-664c818f602f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:52.696845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b36d7-13cc-46d9-be6f-664c818f602f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:52.700051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b36d7-13cc-46d9-be6f-664c818f602f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-5e3b36d7-13cc-46d9-be6f-664c818f602f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:17:52.724192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:52.725287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:52.726293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:17:52.726293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:17:52.726293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:17:52.726293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:17:52.726293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:17:52.726293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:17:52.726293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:52.726293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:52.726293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 259/520] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:52.726293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b36d7-13cc-46d9-be6f-664c818f602f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:52.735764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881df491-b7b3-4f3a-b729-ed464befcd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:52.736593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881df491-b7b3-4f3a-b729-ed464befcd3f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:52.736876 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881df491-b7b3-4f3a-b729-ed464befcd3f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:52.737163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881df491-b7b3-4f3a-b729-ed464befcd3f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:52.745405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881df491-b7b3-4f3a-b729-ed464befcd3f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:52.746926 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881df491-b7b3-4f3a-b729-ed464befcd3f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-881df491-b7b3-4f3a-b729-ed464befcd3f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:17:52.764318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:52.765742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 262/521] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:17:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:52.766879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881df491-b7b3-4f3a-b729-ed464befcd3f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:52.862950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b36d7-13cc-46d9-be6f-664c818f602f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:52.892732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881df491-b7b3-4f3a-b729-ed464befcd3f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:52.922381 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fa66b-8396-4873-ae9c-4e885b24a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:52.923070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa66b-8396-4873-ae9c-4e885b24a835 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:52.923345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa66b-8396-4873-ae9c-4e885b24a835 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:52.923609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fa66b-8396-4873-ae9c-4e885b24a835 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:52.930850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1187f8-a155-4272-bc9a-b56e08f6fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:52.931688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1187f8-a155-4272-bc9a-b56e08f6fec6 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:52.931973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1187f8-a155-4272-bc9a-b56e08f6fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:52.932254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1187f8-a155-4272-bc9a-b56e08f6fec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:52.943738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1187f8-a155-4272-bc9a-b56e08f6fec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:52.945140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1187f8-a155-4272-bc9a-b56e08f6fec6 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-1e1187f8-a155-4272-bc9a-b56e08f6fec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:52.963885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:52.965011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:52.967250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:52.967250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:52.967250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:52.967250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:52.968330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 263/522] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:52.969227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1187f8-a155-4272-bc9a-b56e08f6fec6 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:53.018687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fa66b-8396-4873-ae9c-4e885b24a835 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:53.020602 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fa66b-8396-4873-ae9c-4e885b24a835 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:53.090039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1187f8-a155-4272-bc9a-b56e08f6fec6 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:53.143719 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b94365-e039-4fe8-a187-4967d9d832b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:53.144837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94365-e039-4fe8-a187-4967d9d832b7 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:53.145329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94365-e039-4fe8-a187-4967d9d832b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:53.145808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b94365-e039-4fe8-a187-4967d9d832b7 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:53.147635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b94365-e039-4fe8-a187-4967d9d832b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:53.148171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b94365-e039-4fe8-a187-4967d9d832b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:53.155172 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 260/523] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:53.155172 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fa66b-8396-4873-ae9c-4e885b24a835 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:53.155436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b94365-e039-4fe8-a187-4967d9d832b7 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:53.184051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 264/524] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:17:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:53.186183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b94365-e039-4fe8-a187-4967d9d832b7 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:53.292457 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fa66b-8396-4873-ae9c-4e885b24a835 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:53.329742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b94365-e039-4fe8-a187-4967d9d832b7 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:53.346919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2d557-acfc-4837-b5e3-b0de8f527ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:53.347991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2d557-acfc-4837-b5e3-b0de8f527ede None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:53.348474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2d557-acfc-4837-b5e3-b0de8f527ede None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:53.348936 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2d557-acfc-4837-b5e3-b0de8f527ede None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:53.350339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2d557-acfc-4837-b5e3-b0de8f527ede None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:53.350857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2d557-acfc-4837-b5e3-b0de8f527ede None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:53.353376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2d557-acfc-4837-b5e3-b0de8f527ede None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:53.385820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 261/525] 10.222.0.75 () {56 vars in 1139 bytes} [Thu May 12 14:17:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:53.385820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2d557-acfc-4837-b5e3-b0de8f527ede None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:53.389048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c463-2ddb-4324-afe3-56f8cf5e80d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:53.389902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c463-2ddb-4324-afe3-56f8cf5e80d6 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:53.390190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c463-2ddb-4324-afe3-56f8cf5e80d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:53.390466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289c463-2ddb-4324-afe3-56f8cf5e80d6 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:53.391238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289c463-2ddb-4324-afe3-56f8cf5e80d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:53.391550 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289c463-2ddb-4324-afe3-56f8cf5e80d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:53.392955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289c463-2ddb-4324-afe3-56f8cf5e80d6 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:53.410135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 265/526] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:53.410135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c463-2ddb-4324-afe3-56f8cf5e80d6 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:53.499362 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2d557-acfc-4837-b5e3-b0de8f527ede None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:53.535551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289c463-2ddb-4324-afe3-56f8cf5e80d6 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:53.548821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452e3e-cdde-4f85-8d0f-cc5b73ff4644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:53.549966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452e3e-cdde-4f85-8d0f-cc5b73ff4644 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:53.550378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452e3e-cdde-4f85-8d0f-cc5b73ff4644 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:53.550814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f452e3e-cdde-4f85-8d0f-cc5b73ff4644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:53.570425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f452e3e-cdde-4f85-8d0f-cc5b73ff4644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:53.573317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f452e3e-cdde-4f85-8d0f-cc5b73ff4644 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:53.597215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24261957-6a01-4a96-94d7-6eeb33fd1ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:53.597875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24261957-6a01-4a96-94d7-6eeb33fd1ebc None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:53.598162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24261957-6a01-4a96-94d7-6eeb33fd1ebc None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:53.598441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24261957-6a01-4a96-94d7-6eeb33fd1ebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:53.599322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24261957-6a01-4a96-94d7-6eeb33fd1ebc None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=2366609a0a564e7fbcb05b503de78580) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:53.599641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24261957-6a01-4a96-94d7-6eeb33fd1ebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:53.601087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24261957-6a01-4a96-94d7-6eeb33fd1ebc None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-9f452e3e-cdde-4f85-8d0f-cc5b73ff4644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:53.607196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:53.608280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:53.609346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:53.609346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:53.609346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:53.609346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:53.624015 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 266/527] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:53 2022] GET /identity/v3/role_assignments?user.id=2366609a0a564e7fbcb05b503de78580&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:53.624015 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24261957-6a01-4a96-94d7-6eeb33fd1ebc None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:53.624317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 262/528] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:53.624317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452e3e-cdde-4f85-8d0f-cc5b73ff4644 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:53.771791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f452e3e-cdde-4f85-8d0f-cc5b73ff4644 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:53.778172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24261957-6a01-4a96-94d7-6eeb33fd1ebc None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:53.816690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4d51-32de-428a-9df3-1e439db8c95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:53.818110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4d51-32de-428a-9df3-1e439db8c95c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:53.818697 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4d51-32de-428a-9df3-1e439db8c95c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:53.819341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd4d51-32de-428a-9df3-1e439db8c95c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:53.820522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab67ae-cf35-4e42-a85b-b8813666de3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:53.821196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab67ae-cf35-4e42-a85b-b8813666de3f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:53.821482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab67ae-cf35-4e42-a85b-b8813666de3f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:53.821762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab67ae-cf35-4e42-a85b-b8813666de3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:53.833767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd4d51-32de-428a-9df3-1e439db8c95c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:53.836239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd4d51-32de-428a-9df3-1e439db8c95c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-e0cd4d51-32de-428a-9df3-1e439db8c95c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:17:53.864835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:53.866252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:53.867351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:17:53.867351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:17:53.867351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:17:53.867351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:17:53.867351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:17:53.867351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:17:53.867351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:53.867351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:53.869944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 263/529] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:53.871587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4d51-32de-428a-9df3-1e439db8c95c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:53.900526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab67ae-cf35-4e42-a85b-b8813666de3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:53.902054 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab67ae-cf35-4e42-a85b-b8813666de3f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:53.983371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd4d51-32de-428a-9df3-1e439db8c95c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:54.014364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 267/530] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:54.015617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab67ae-cf35-4e42-a85b-b8813666de3f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:54.022692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fc4d1-acf5-4d6d-8694-948050253a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:54.023407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fc4d1-acf5-4d6d-8694-948050253a15 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:54.023693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fc4d1-acf5-4d6d-8694-948050253a15 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:54.023972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fc4d1-acf5-4d6d-8694-948050253a15 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:54.024719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fc4d1-acf5-4d6d-8694-948050253a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:54.025492 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fc4d1-acf5-4d6d-8694-948050253a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:54.026484 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fc4d1-acf5-4d6d-8694-948050253a15 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:54.044088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 264/531] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:54.046275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fc4d1-acf5-4d6d-8694-948050253a15 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:54.120712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab67ae-cf35-4e42-a85b-b8813666de3f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:54.152895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fc4d1-acf5-4d6d-8694-948050253a15 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:54.159906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59a7c-30f4-4098-93a7-100b646b7bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:54.160972 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59a7c-30f4-4098-93a7-100b646b7bdb None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:54.161466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59a7c-30f4-4098-93a7-100b646b7bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:54.161951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c59a7c-30f4-4098-93a7-100b646b7bdb None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:54.162969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c59a7c-30f4-4098-93a7-100b646b7bdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:54.163537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c59a7c-30f4-4098-93a7-100b646b7bdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:54.165216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c59a7c-30f4-4098-93a7-100b646b7bdb None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:54.178175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 268/532] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:54.179436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59a7c-30f4-4098-93a7-100b646b7bdb None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:54.201501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079dbab-8a63-45f4-9066-276eb6a8f719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:54.202347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079dbab-8a63-45f4-9066-276eb6a8f719 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:54.202634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079dbab-8a63-45f4-9066-276eb6a8f719 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:54.202913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079dbab-8a63-45f4-9066-276eb6a8f719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:54.213676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079dbab-8a63-45f4-9066-276eb6a8f719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:54.215385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079dbab-8a63-45f4-9066-276eb6a8f719 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-6079dbab-8a63-45f4-9066-276eb6a8f719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:54.236062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:54.236988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:54.237842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:54.237842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:54.237842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:54.237842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:54.241844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 265/533] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:54.242762 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079dbab-8a63-45f4-9066-276eb6a8f719 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:54.292516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c59a7c-30f4-4098-93a7-100b646b7bdb None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:54.328829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e566170-64aa-439f-bec7-26a1280327af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:54.330094 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e566170-64aa-439f-bec7-26a1280327af None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:54.330628 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e566170-64aa-439f-bec7-26a1280327af None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:54.331153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e566170-64aa-439f-bec7-26a1280327af None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:54.338956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e566170-64aa-439f-bec7-26a1280327af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:54.340862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e566170-64aa-439f-bec7-26a1280327af None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:54.350975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079dbab-8a63-45f4-9066-276eb6a8f719 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-3e566170-64aa-439f-bec7-26a1280327af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:17:54.358654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:54.359601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:54.360431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:17:54.360431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:17:54.360431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:17:54.360431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:17:54.360431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:17:54.360431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:17:54.360431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:54.360431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:54.362914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 269/534] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:54.363958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e566170-64aa-439f-bec7-26a1280327af None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:54.399449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120372ac-b469-41d1-9b48-1251e3ed60ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:54.400066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120372ac-b469-41d1-9b48-1251e3ed60ea None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:54.400352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120372ac-b469-41d1-9b48-1251e3ed60ea None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:54.400630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120372ac-b469-41d1-9b48-1251e3ed60ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:54.401482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120372ac-b469-41d1-9b48-1251e3ed60ea None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=10414e35df26406786eaf49c52661cee) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:54.401801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120372ac-b469-41d1-9b48-1251e3ed60ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:54.403312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120372ac-b469-41d1-9b48-1251e3ed60ea None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:54.415188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 266/535] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:54 2022] GET /identity/v3/role_assignments?user.id=10414e35df26406786eaf49c52661cee&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:54.416238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120372ac-b469-41d1-9b48-1251e3ed60ea None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:54.486939 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e566170-64aa-439f-bec7-26a1280327af None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:54.533228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf995b4-ed3e-4fcb-8e4c-af7e3ee849d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:54.535405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf995b4-ed3e-4fcb-8e4c-af7e3ee849d1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:54.537547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf995b4-ed3e-4fcb-8e4c-af7e3ee849d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:54.538087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf995b4-ed3e-4fcb-8e4c-af7e3ee849d1 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:54.539141 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf995b4-ed3e-4fcb-8e4c-af7e3ee849d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:54.540813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf995b4-ed3e-4fcb-8e4c-af7e3ee849d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:54.542498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf995b4-ed3e-4fcb-8e4c-af7e3ee849d1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:54.574675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 270/536] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:54.581895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf995b4-ed3e-4fcb-8e4c-af7e3ee849d1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:54.623880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120372ac-b469-41d1-9b48-1251e3ed60ea None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:54.701412 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad8e5d-1a0b-481b-8c06-77932c0b0fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:54.702621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad8e5d-1a0b-481b-8c06-77932c0b0fe9 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:54.702907 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad8e5d-1a0b-481b-8c06-77932c0b0fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:54.703709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad8e5d-1a0b-481b-8c06-77932c0b0fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:54.705264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad8e5d-1a0b-481b-8c06-77932c0b0fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:54.705581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad8e5d-1a0b-481b-8c06-77932c0b0fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:54.707087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad8e5d-1a0b-481b-8c06-77932c0b0fe9 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:54.737188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 267/537] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:54.752745 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad8e5d-1a0b-481b-8c06-77932c0b0fe9 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:54.756869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf995b4-ed3e-4fcb-8e4c-af7e3ee849d1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:54.796000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdc840-5b77-4dbe-a5f9-1cfb60e1eb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:54.797265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdc840-5b77-4dbe-a5f9-1cfb60e1eb91 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:54.797758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdc840-5b77-4dbe-a5f9-1cfb60e1eb91 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:54.798244 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdc840-5b77-4dbe-a5f9-1cfb60e1eb91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:54.806854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdc840-5b77-4dbe-a5f9-1cfb60e1eb91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:54.808756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdc840-5b77-4dbe-a5f9-1cfb60e1eb91 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-35fdc840-5b77-4dbe-a5f9-1cfb60e1eb91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:17:54.824965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:54.826470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:54.827358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:17:54.827358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:17:54.827358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:17:54.827358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:17:54.827358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:17:54.827358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:17:54.827358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:54.827358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:54.834694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 271/538] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:54.836526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdc840-5b77-4dbe-a5f9-1cfb60e1eb91 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:54.895354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad8e5d-1a0b-481b-8c06-77932c0b0fe9 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:54.936724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b703308-61cb-4900-88e6-eec4dfcfdef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:54.937413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b703308-61cb-4900-88e6-eec4dfcfdef1 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:54.937700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b703308-61cb-4900-88e6-eec4dfcfdef1 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:54.937975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b703308-61cb-4900-88e6-eec4dfcfdef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:54.938889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b703308-61cb-4900-88e6-eec4dfcfdef1 None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=cbe18e038b414ef0956a4e8a86586b88) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:54.940989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b703308-61cb-4900-88e6-eec4dfcfdef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:54.940989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b703308-61cb-4900-88e6-eec4dfcfdef1 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:54.947751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 268/539] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:54 2022] GET /identity/v3/role_assignments?user.id=cbe18e038b414ef0956a4e8a86586b88&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:54.999020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb7143-6c2e-48ca-8942-d45f0be11653 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:54.999425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb7143-6c2e-48ca-8942-d45f0be11653 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:54.999629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb7143-6c2e-48ca-8942-d45f0be11653 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:55.001465 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 269/540] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:55.012605 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70e6a-5962-4e61-aefc-959ed341e2c5 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:55.012898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70e6a-5962-4e61-aefc-959ed341e2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:55.013818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70e6a-5962-4e61-aefc-959ed341e2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:55.016490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdc840-5b77-4dbe-a5f9-1cfb60e1eb91 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:55.057788 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f9d70e6a-5962-4e61-aefc-959ed341e2c5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:55.059061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f9d70e6a-5962-4e61-aefc-959ed341e2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:55.072458 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650bc7-0397-414f-bcbd-b2cc5026e19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:55.073147 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650bc7-0397-414f-bcbd-b2cc5026e19e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:55.073434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650bc7-0397-414f-bcbd-b2cc5026e19e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:55.073746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5650bc7-0397-414f-bcbd-b2cc5026e19e None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:55.074575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5650bc7-0397-414f-bcbd-b2cc5026e19e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:55.074890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5650bc7-0397-414f-bcbd-b2cc5026e19e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:55.076493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5650bc7-0397-414f-bcbd-b2cc5026e19e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:55.099417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 272/541] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:55.105629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650bc7-0397-414f-bcbd-b2cc5026e19e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:55.190312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 270/542] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 12 14:17:55.227513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70e6a-5962-4e61-aefc-959ed341e2c5 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:55.271175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5650bc7-0397-414f-bcbd-b2cc5026e19e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:55.314435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ad60-b5a0-4e2b-8112-a71d7ff13b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:55.315130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ad60-b5a0-4e2b-8112-a71d7ff13b2f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:55.316406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ad60-b5a0-4e2b-8112-a71d7ff13b2f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:55.317695 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497ad60-b5a0-4e2b-8112-a71d7ff13b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:55.318553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497ad60-b5a0-4e2b-8112-a71d7ff13b2f None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=5aca248c2e074fc4baff39930e21fe29) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:55.318870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497ad60-b5a0-4e2b-8112-a71d7ff13b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:55.320595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497ad60-b5a0-4e2b-8112-a71d7ff13b2f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:55.336232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 273/543] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:55 2022] GET /identity/v3/role_assignments?user.id=5aca248c2e074fc4baff39930e21fe29&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:55.361288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70e6a-5962-4e61-aefc-959ed341e2c5 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:55.400989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee823f-233b-4c69-80b0-2de880689342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:55.401808 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee823f-233b-4c69-80b0-2de880689342 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:55.402096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee823f-233b-4c69-80b0-2de880689342 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:55.402397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee823f-233b-4c69-80b0-2de880689342 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:55.415583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee823f-233b-4c69-80b0-2de880689342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-2bee823f-233b-4c69-80b0-2de880689342 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:55.424476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:55.427943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:55.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 271/544] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:17:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:55.439459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ad60-b5a0-4e2b-8112-a71d7ff13b2f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:55.584941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497ad60-b5a0-4e2b-8112-a71d7ff13b2f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:55.631325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204751-fd46-422d-893f-10fe9e2b011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:55.632008 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204751-fd46-422d-893f-10fe9e2b011d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:55.632292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204751-fd46-422d-893f-10fe9e2b011d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:55.632561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204751-fd46-422d-893f-10fe9e2b011d None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:55.633321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3204751-fd46-422d-893f-10fe9e2b011d None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:55.633604 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3204751-fd46-422d-893f-10fe9e2b011d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:55.634987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3204751-fd46-422d-893f-10fe9e2b011d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:55.644806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 274/545] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:17:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:55.651066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee823f-233b-4c69-80b0-2de880689342 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:55.773719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee823f-233b-4c69-80b0-2de880689342 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:55.814817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75561ab-178b-49fe-ae10-2240647dc9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:55.815722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75561ab-178b-49fe-ae10-2240647dc9fb None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:55.816009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75561ab-178b-49fe-ae10-2240647dc9fb None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:55.816268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75561ab-178b-49fe-ae10-2240647dc9fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:55.828344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75561ab-178b-49fe-ae10-2240647dc9fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:55.835393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75561ab-178b-49fe-ae10-2240647dc9fb None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-b75561ab-178b-49fe-ae10-2240647dc9fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:55.858667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:55.862235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:55.873399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:55.873399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:55.873399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:55.873399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:55.873399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 272/546] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:55.874391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204751-fd46-422d-893f-10fe9e2b011d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:56.025002 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204751-fd46-422d-893f-10fe9e2b011d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:56.071689 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6be641-f7a6-481d-bab1-73e9aa99af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:56.072419 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6be641-f7a6-481d-bab1-73e9aa99af0c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:56.072706 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6be641-f7a6-481d-bab1-73e9aa99af0c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:56.072985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6be641-f7a6-481d-bab1-73e9aa99af0c None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:56.073724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6be641-f7a6-481d-bab1-73e9aa99af0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:56.074032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6be641-f7a6-481d-bab1-73e9aa99af0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:56.075443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6be641-f7a6-481d-bab1-73e9aa99af0c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:56.094898 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 275/547] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:56.100175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75561ab-178b-49fe-ae10-2240647dc9fb None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:56.230513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75561ab-178b-49fe-ae10-2240647dc9fb None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:56.257120 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2caca-3b40-4402-97eb-2018b5ffef40 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:56.257429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2caca-3b40-4402-97eb-2018b5ffef40 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:56.257670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2caca-3b40-4402-97eb-2018b5ffef40 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:56.259367 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 276/548] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:17:56.265870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648b0d9-14ab-4d9a-b3b9-ee759fee31d9 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:56.266190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648b0d9-14ab-4d9a-b3b9-ee759fee31d9 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:56.266428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648b0d9-14ab-4d9a-b3b9-ee759fee31d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:56.273514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9e957-9e02-4bf5-a693-6ad8f36a4123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:56.274384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9e957-9e02-4bf5-a693-6ad8f36a4123 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:56.274672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9e957-9e02-4bf5-a693-6ad8f36a4123 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:56.274947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9e957-9e02-4bf5-a693-6ad8f36a4123 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:56.283900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9e957-9e02-4bf5-a693-6ad8f36a4123 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:56.285418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9e957-9e02-4bf5-a693-6ad8f36a4123 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:56.304151 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2648b0d9-14ab-4d9a-b3b9-ee759fee31d9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:56.305374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2648b0d9-14ab-4d9a-b3b9-ee759fee31d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c9e9e957-9e02-4bf5-a693-6ad8f36a4123 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:17:56.306905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:56.308991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:56.312075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 273/549] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:17:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:56.318500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9e957-9e02-4bf5-a693-6ad8f36a4123 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:56.438138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9e957-9e02-4bf5-a693-6ad8f36a4123 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:56.456560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 277/550] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:56.476681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c956d-c91b-4bb6-b51a-d844280dd9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:56.477364 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c956d-c91b-4bb6-b51a-d844280dd9d1 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:56.477647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c956d-c91b-4bb6-b51a-d844280dd9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:56.477922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c956d-c91b-4bb6-b51a-d844280dd9d1 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:56.478773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c956d-c91b-4bb6-b51a-d844280dd9d1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:56.479117 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c956d-c91b-4bb6-b51a-d844280dd9d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:56.480614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c956d-c91b-4bb6-b51a-d844280dd9d1 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:56.501154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 274/551] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 12 14:17:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:56.506731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648b0d9-14ab-4d9a-b3b9-ee759fee31d9 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:56.509688 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c956d-c91b-4bb6-b51a-d844280dd9d1 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:56.684403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c956d-c91b-4bb6-b51a-d844280dd9d1 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:56.709017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2648b0d9-14ab-4d9a-b3b9-ee759fee31d9 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:56.725239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92054b-87af-45f9-82df-9063805f728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:56.725901 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92054b-87af-45f9-82df-9063805f728f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:56.726181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92054b-87af-45f9-82df-9063805f728f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:56.726457 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92054b-87af-45f9-82df-9063805f728f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:56.780776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc774c-b5d2-42c7-a903-0abc779d7dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:56.781955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc774c-b5d2-42c7-a903-0abc779d7dd1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:56.782452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc774c-b5d2-42c7-a903-0abc779d7dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:56.782936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc774c-b5d2-42c7-a903-0abc779d7dd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:56.803889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc774c-b5d2-42c7-a903-0abc779d7dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-f3bc774c-b5d2-42c7-a903-0abc779d7dd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:56.819016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:56.820046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:56.820953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:56.827156 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92054b-87af-45f9-82df-9063805f728f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:56.828967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92054b-87af-45f9-82df-9063805f728f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:56.831740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 278/552] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:56.846715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc774c-b5d2-42c7-a903-0abc779d7dd1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:56.985105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 275/553] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:17:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:17:56.991064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92054b-87af-45f9-82df-9063805f728f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:57.105106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc774c-b5d2-42c7-a903-0abc779d7dd1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:57.166511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92054b-87af-45f9-82df-9063805f728f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:57.207871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb52ad5-a7cd-4c4e-823c-251d4b1a3668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:57.208590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb52ad5-a7cd-4c4e-823c-251d4b1a3668 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:57.208875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb52ad5-a7cd-4c4e-823c-251d4b1a3668 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:57.209153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb52ad5-a7cd-4c4e-823c-251d4b1a3668 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:57.210084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb52ad5-a7cd-4c4e-823c-251d4b1a3668 None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:57.210396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb52ad5-a7cd-4c4e-823c-251d4b1a3668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:57.211915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb52ad5-a7cd-4c4e-823c-251d4b1a3668 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:57.234227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca044e2-b453-469a-a682-fa539785a019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:57.235340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca044e2-b453-469a-a682-fa539785a019 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:57.235782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca044e2-b453-469a-a682-fa539785a019 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:57.237246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca044e2-b453-469a-a682-fa539785a019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:57.242222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 279/554] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:17:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:57.244414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb52ad5-a7cd-4c4e-823c-251d4b1a3668 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:57.257190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca044e2-b453-469a-a682-fa539785a019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:57.258965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca044e2-b453-469a-a682-fa539785a019 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-2ca044e2-b453-469a-a682-fa539785a019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:57.283349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:57.285065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:57.287019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:57.287019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:57.287019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:57.287019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:57.290459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 276/555] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:57.299443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca044e2-b453-469a-a682-fa539785a019 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:57.504713 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca044e2-b453-469a-a682-fa539785a019 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:57.549516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b78a2-8e78-44dc-ab04-d9a46b79b14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:57.550884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b78a2-8e78-44dc-ab04-d9a46b79b14d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:57.551382 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b78a2-8e78-44dc-ab04-d9a46b79b14d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:57.552025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b78a2-8e78-44dc-ab04-d9a46b79b14d None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:57.553114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b78a2-8e78-44dc-ab04-d9a46b79b14d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:57.553624 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b78a2-8e78-44dc-ab04-d9a46b79b14d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:57.555540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b78a2-8e78-44dc-ab04-d9a46b79b14d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:57.565185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb52ad5-a7cd-4c4e-823c-251d4b1a3668 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:57.571917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 277/556] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:17:57.582930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b78a2-8e78-44dc-ab04-d9a46b79b14d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:57.629593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb14fca-1d2c-437d-8c30-a499722c1d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:57.630796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb14fca-1d2c-437d-8c30-a499722c1d83 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:57.631364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb14fca-1d2c-437d-8c30-a499722c1d83 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:57.631896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb14fca-1d2c-437d-8c30-a499722c1d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:57.644099 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb14fca-1d2c-437d-8c30-a499722c1d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:57.646219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb14fca-1d2c-437d-8c30-a499722c1d83 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-7cb14fca-1d2c-437d-8c30-a499722c1d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:57.665079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:57.666132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:57.666983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:57.666983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:57.666983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:57.666983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:57.674751 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 280/557] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:17:57.677242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9402f00-a045-4e2c-b754-aa24d599b6c2 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:57.677931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9402f00-a045-4e2c-b754-aa24d599b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:57.678606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9402f00-a045-4e2c-b754-aa24d599b6c2 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:57.687082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 281/558] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:57.687082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9402f00-a045-4e2c-b754-aa24d599b6c2 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:57.727136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b78a2-8e78-44dc-ab04-d9a46b79b14d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:57.782990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d114a-f8aa-4f1b-a45e-cd548668d2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:57.784814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d114a-f8aa-4f1b-a45e-cd548668d2a0 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:57.785249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d114a-f8aa-4f1b-a45e-cd548668d2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:57.785665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d114a-f8aa-4f1b-a45e-cd548668d2a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:57.803095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d114a-f8aa-4f1b-a45e-cd548668d2a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:57.803095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d114a-f8aa-4f1b-a45e-cd548668d2a0 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:57.811470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9402f00-a045-4e2c-b754-aa24d599b6c2 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-881d114a-f8aa-4f1b-a45e-cd548668d2a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:17:57.832977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:57.833941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:57.834783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:17:57.834783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:17:57.834783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:17:57.834783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:17:57.834783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:17:57.834783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:17:57.834783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:57.834783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:57.834783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 278/559] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:57.836267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654711c4-f717-480f-af3d-9f940bb24af4 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:57.836267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654711c4-f717-480f-af3d-9f940bb24af4 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:57.836267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654711c4-f717-480f-af3d-9f940bb24af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:57.860705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-654711c4-f717-480f-af3d-9f940bb24af4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:57.861940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-654711c4-f717-480f-af3d-9f940bb24af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:57.870776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a4d09-b8ba-4cd4-9655-3532fa010c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:57.871847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4d09-b8ba-4cd4-9655-3532fa010c5d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:57.872288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4d09-b8ba-4cd4-9655-3532fa010c5d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:57.873329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a4d09-b8ba-4cd4-9655-3532fa010c5d None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:57.874586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a4d09-b8ba-4cd4-9655-3532fa010c5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:57.875133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a4d09-b8ba-4cd4-9655-3532fa010c5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:57.877443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a4d09-b8ba-4cd4-9655-3532fa010c5d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:57.899206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 282/560] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:57.900817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98149-ce6e-4a44-9bdc-c17152b3ca62 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:57.901101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98149-ce6e-4a44-9bdc-c17152b3ca62 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:57.901373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b98149-ce6e-4a44-9bdc-c17152b3ca62 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:57.902860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 283/561] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:57.904602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98149-ce6e-4a44-9bdc-c17152b3ca62 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:57.957331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 279/562] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:57.959062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7c9f6-70f1-45a2-8dc7-988c6fd114ae None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:57.962222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7c9f6-70f1-45a2-8dc7-988c6fd114ae None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:57.962754 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7c9f6-70f1-45a2-8dc7-988c6fd114ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:57.989744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-58c7c9f6-70f1-45a2-8dc7-988c6fd114ae None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:57.991080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-58c7c9f6-70f1-45a2-8dc7-988c6fd114ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:58.038249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b98149-ce6e-4a44-9bdc-c17152b3ca62 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:58.078913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08521618-8f32-4449-8fec-7f96a32a9f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:58.080298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08521618-8f32-4449-8fec-7f96a32a9f20 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.080765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08521618-8f32-4449-8fec-7f96a32a9f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.080977 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08521618-8f32-4449-8fec-7f96a32a9f20 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.086564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08521618-8f32-4449-8fec-7f96a32a9f20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:58.086564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08521618-8f32-4449-8fec-7f96a32a9f20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:58.086564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08521618-8f32-4449-8fec-7f96a32a9f20 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:58.107440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 280/563] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:58.107440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7c9f6-70f1-45a2-8dc7-988c6fd114ae None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:58.113864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 284/564] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:17:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:58.114876 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08521618-8f32-4449-8fec-7f96a32a9f20 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:58.228295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7c9f6-70f1-45a2-8dc7-988c6fd114ae None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:58.240549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08521618-8f32-4449-8fec-7f96a32a9f20 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:58.270557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e34b1-0c69-4b95-ad18-513bc97a0569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:58.271679 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e34b1-0c69-4b95-ad18-513bc97a0569 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.272295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e34b1-0c69-4b95-ad18-513bc97a0569 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.272295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e34b1-0c69-4b95-ad18-513bc97a0569 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.277678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86464ffa-cc7d-4211-878a-1bbc68d76773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:58.278498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86464ffa-cc7d-4211-878a-1bbc68d76773 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.279345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86464ffa-cc7d-4211-878a-1bbc68d76773 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.279627 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86464ffa-cc7d-4211-878a-1bbc68d76773 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.281039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e34b1-0c69-4b95-ad18-513bc97a0569 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:58.282827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e34b1-0c69-4b95-ad18-513bc97a0569 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:58.292025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86464ffa-cc7d-4211-878a-1bbc68d76773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-6b6e34b1-0c69-4b95-ad18-513bc97a0569 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:17:58.300210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:58.301553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:58.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:58.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:58.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:17:58.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:17:58.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:17:58.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:17:58.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:17:58.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:17:58.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:17:58.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-86464ffa-cc7d-4211-878a-1bbc68d76773 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:58.312188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:58.313797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 285/565] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:17:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:58.315728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86464ffa-cc7d-4211-878a-1bbc68d76773 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:58.318409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 281/566] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 12 14:17:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:58.318409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e34b1-0c69-4b95-ad18-513bc97a0569 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:58.428676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e34b1-0c69-4b95-ad18-513bc97a0569 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:58.433225 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86464ffa-cc7d-4211-878a-1bbc68d76773 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:58.469531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a1bfe-b480-46cb-b213-caf4bda6a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:58.470215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a1bfe-b480-46cb-b213-caf4bda6a916 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.470499 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a1bfe-b480-46cb-b213-caf4bda6a916 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.470768 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a1bfe-b480-46cb-b213-caf4bda6a916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.471667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a1bfe-b480-46cb-b213-caf4bda6a916 None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=2893125208864a1ab2c32e50d5da3f83) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:58.471983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a1bfe-b480-46cb-b213-caf4bda6a916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:58.472583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00bd4-8df2-4546-bc76-17e8f86b92e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:58.473432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00bd4-8df2-4546-bc76-17e8f86b92e6 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.473545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a1bfe-b480-46cb-b213-caf4bda6a916 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:58.473720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00bd4-8df2-4546-bc76-17e8f86b92e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.473998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e00bd4-8df2-4546-bc76-17e8f86b92e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.487444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 286/567] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:17:58 2022] GET /identity/v3/role_assignments?user.id=2893125208864a1ab2c32e50d5da3f83&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:58.487444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a1bfe-b480-46cb-b213-caf4bda6a916 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:58.495795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e00bd4-8df2-4546-bc76-17e8f86b92e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c0e00bd4-8df2-4546-bc76-17e8f86b92e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:58.511981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:58.513626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:58.514493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:58.515163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 282/568] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:17:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:58.516182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00bd4-8df2-4546-bc76-17e8f86b92e6 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:58.612425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a1bfe-b480-46cb-b213-caf4bda6a916 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:58.648430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e00bd4-8df2-4546-bc76-17e8f86b92e6 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:58.653008 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621e56d-c2f1-4c02-90a1-59df0c1cd9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:58.653858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621e56d-c2f1-4c02-90a1-59df0c1cd9c4 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.654644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621e56d-c2f1-4c02-90a1-59df0c1cd9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.654924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621e56d-c2f1-4c02-90a1-59df0c1cd9c4 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.655872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621e56d-c2f1-4c02-90a1-59df0c1cd9c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:58.656193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621e56d-c2f1-4c02-90a1-59df0c1cd9c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:58.657743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621e56d-c2f1-4c02-90a1-59df0c1cd9c4 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:58.687151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274a293-6e4b-46e4-8b86-2c78ccac1d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:58.687852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a293-6e4b-46e4-8b86-2c78ccac1d21 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.688137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a293-6e4b-46e4-8b86-2c78ccac1d21 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.688413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274a293-6e4b-46e4-8b86-2c78ccac1d21 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.689194 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274a293-6e4b-46e4-8b86-2c78ccac1d21 None admin] RBAC: Adding query filter params (name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:58.689504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274a293-6e4b-46e4-8b86-2c78ccac1d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:58.690976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274a293-6e4b-46e4-8b86-2c78ccac1d21 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:58.698393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 287/569] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 12 14:17:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:58.700145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4762df-6745-4d5f-b5b4-6a27bce4e772 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.700145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4762df-6745-4d5f-b5b4-6a27bce4e772 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.700415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4762df-6745-4d5f-b5b4-6a27bce4e772 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.702409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 288/570] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:17:58.703189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4762df-6745-4d5f-b5b4-6a27bce4e772 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:58.709451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 283/571] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:17:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:58.709880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274a293-6e4b-46e4-8b86-2c78ccac1d21 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:58.823855 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4762df-6745-4d5f-b5b4-6a27bce4e772 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:58.834138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274a293-6e4b-46e4-8b86-2c78ccac1d21 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:58.864982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769e742-037f-4fce-8555-a9f1446ca0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:58.866010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769e742-037f-4fce-8555-a9f1446ca0f5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.866475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769e742-037f-4fce-8555-a9f1446ca0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.866931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769e742-037f-4fce-8555-a9f1446ca0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.868298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769e742-037f-4fce-8555-a9f1446ca0f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:58.868823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769e742-037f-4fce-8555-a9f1446ca0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:58.871384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769e742-037f-4fce-8555-a9f1446ca0f5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:58.876963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f7f1-8212-4444-a6d6-253e4e47da00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:58.877797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f7f1-8212-4444-a6d6-253e4e47da00 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.878084 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f7f1-8212-4444-a6d6-253e4e47da00 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.878370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8f7f1-8212-4444-a6d6-253e4e47da00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.885640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 289/572] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:17:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:58.887995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4a3a6-a2b9-4ec3-aaf3-362cb137cbf7 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:58.888536 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4a3a6-a2b9-4ec3-aaf3-362cb137cbf7 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:58.889101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4a3a6-a2b9-4ec3-aaf3-362cb137cbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:58.899852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f7f1-8212-4444-a6d6-253e4e47da00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:58.901396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8f7f1-8212-4444-a6d6-253e4e47da00 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:58.912017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-01d4a3a6-a2b9-4ec3-aaf3-362cb137cbf7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:17:58.913300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-01d4a3a6-a2b9-4ec3-aaf3-362cb137cbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-bda8f7f1-8212-4444-a6d6-253e4e47da00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:58.923257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:58.924981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:58.929202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:58.929202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:58.929202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:58.929202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:58.929202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 284/573] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:58.929202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f7f1-8212-4444-a6d6-253e4e47da00 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:58.996229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 290/574] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:17:58.997606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4a3a6-a2b9-4ec3-aaf3-362cb137cbf7 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:59.041571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8f7f1-8212-4444-a6d6-253e4e47da00 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:59.077515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c214d9-de67-4080-b00c-96a2ecedbb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:59.078334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c214d9-de67-4080-b00c-96a2ecedbb5b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:59.078622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c214d9-de67-4080-b00c-96a2ecedbb5b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:59.078904 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c214d9-de67-4080-b00c-96a2ecedbb5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:59.089975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c214d9-de67-4080-b00c-96a2ecedbb5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:59.092126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c214d9-de67-4080-b00c-96a2ecedbb5b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-46c214d9-de67-4080-b00c-96a2ecedbb5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:59.113233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:59.114308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:59.115272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:59.115272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:59.115272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:59.115272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:59.119269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 285/575] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:59.120223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c214d9-de67-4080-b00c-96a2ecedbb5b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:59.127159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4a3a6-a2b9-4ec3-aaf3-362cb137cbf7 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:59.171840 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9302c-36bd-4f35-9e75-ace35a4dac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:59.172933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9302c-36bd-4f35-9e75-ace35a4dac70 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:59.173224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9302c-36bd-4f35-9e75-ace35a4dac70 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:59.173502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9302c-36bd-4f35-9e75-ace35a4dac70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:59.184016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9302c-36bd-4f35-9e75-ace35a4dac70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:59.186193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9302c-36bd-4f35-9e75-ace35a4dac70 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-bce9302c-36bd-4f35-9e75-ace35a4dac70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:17:59.205534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:59.206498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:59.207547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:17:59.207547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:17:59.207547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:17:59.207547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:59.207547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 291/576] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:59.208622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9302c-36bd-4f35-9e75-ace35a4dac70 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:59.238041 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c214d9-de67-4080-b00c-96a2ecedbb5b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:59.276027 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d2a3d-a4df-4dee-aeac-c9b0023b267c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:59.277003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d2a3d-a4df-4dee-aeac-c9b0023b267c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:59.277447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d2a3d-a4df-4dee-aeac-c9b0023b267c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:59.277871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d2a3d-a4df-4dee-aeac-c9b0023b267c None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:59.278830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d2a3d-a4df-4dee-aeac-c9b0023b267c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:59.279267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d2a3d-a4df-4dee-aeac-c9b0023b267c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:59.280757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d2a3d-a4df-4dee-aeac-c9b0023b267c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:59.298496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 286/577] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:59.298496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d2a3d-a4df-4dee-aeac-c9b0023b267c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:59.334312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9302c-36bd-4f35-9e75-ace35a4dac70 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:59.374932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3193945-3dd0-4362-aefc-ed7d3b6f1c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:59.375764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193945-3dd0-4362-aefc-ed7d3b6f1c06 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:59.376045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193945-3dd0-4362-aefc-ed7d3b6f1c06 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:59.376317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3193945-3dd0-4362-aefc-ed7d3b6f1c06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:59.387012 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3193945-3dd0-4362-aefc-ed7d3b6f1c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-c3193945-3dd0-4362-aefc-ed7d3b6f1c06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:17:59.396980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:59.398018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:17:59.398851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:59.400049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 292/578] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:17:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:59.400871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3193945-3dd0-4362-aefc-ed7d3b6f1c06 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:59.432928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d2a3d-a4df-4dee-aeac-c9b0023b267c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:59.477653 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb895-8f08-4ac9-a094-79e7c31b6fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:59.478998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb895-8f08-4ac9-a094-79e7c31b6fcd None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:59.479450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb895-8f08-4ac9-a094-79e7c31b6fcd None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:59.479855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb895-8f08-4ac9-a094-79e7c31b6fcd None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:59.480572 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fb895-8f08-4ac9-a094-79e7c31b6fcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:59.481008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fb895-8f08-4ac9-a094-79e7c31b6fcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:59.483225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fb895-8f08-4ac9-a094-79e7c31b6fcd None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:59.510513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 287/579] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:59.510513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb895-8f08-4ac9-a094-79e7c31b6fcd None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:59.537740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3193945-3dd0-4362-aefc-ed7d3b6f1c06 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:59.573303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af763f09-17e8-4af4-a00a-637ef7782bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:59.573974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763f09-17e8-4af4-a00a-637ef7782bdc None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:59.574253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763f09-17e8-4af4-a00a-637ef7782bdc None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:59.574526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af763f09-17e8-4af4-a00a-637ef7782bdc None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:59.575289 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af763f09-17e8-4af4-a00a-637ef7782bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:59.576141 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af763f09-17e8-4af4-a00a-637ef7782bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:59.577537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af763f09-17e8-4af4-a00a-637ef7782bdc None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:59.596700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 293/580] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:59.596700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af763f09-17e8-4af4-a00a-637ef7782bdc None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:59.638701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb895-8f08-4ac9-a094-79e7c31b6fcd None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:59.672200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa5004-5dbe-41cd-ad0b-52b2b6d48f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:59.673010 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5004-5dbe-41cd-ad0b-52b2b6d48f4f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:59.673297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5004-5dbe-41cd-ad0b-52b2b6d48f4f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:59.673570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5004-5dbe-41cd-ad0b-52b2b6d48f4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:59.680838 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa5004-5dbe-41cd-ad0b-52b2b6d48f4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:59.682322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa5004-5dbe-41cd-ad0b-52b2b6d48f4f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-37fa5004-5dbe-41cd-ad0b-52b2b6d48f4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:17:59.698481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:59.699537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:59.700418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:17:59.700418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:17:59.700418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:17:59.700418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:17:59.700418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:17:59.700418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:17:59.700418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:17:59.700418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:59.700418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 288/581] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:59.701546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa5004-5dbe-41cd-ad0b-52b2b6d48f4f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:59.710659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af763f09-17e8-4af4-a00a-637ef7782bdc None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:59.745853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d79c-755e-4c0a-b59c-85e395799c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:59.746543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d79c-755e-4c0a-b59c-85e395799c03 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:59.747018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d79c-755e-4c0a-b59c-85e395799c03 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:59.747309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d79c-755e-4c0a-b59c-85e395799c03 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:59.748500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1d79c-755e-4c0a-b59c-85e395799c03 None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:17:59.748821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1d79c-755e-4c0a-b59c-85e395799c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:59.750233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1d79c-755e-4c0a-b59c-85e395799c03 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:59.764631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 294/582] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:17:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:17:59.765626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d79c-755e-4c0a-b59c-85e395799c03 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:59.812551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa5004-5dbe-41cd-ad0b-52b2b6d48f4f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:59.860926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032a589-d74c-48d7-9cc6-367507030edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:59.862597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a589-d74c-48d7-9cc6-367507030edf None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:59.862711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a589-d74c-48d7-9cc6-367507030edf None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:59.863165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032a589-d74c-48d7-9cc6-367507030edf None admin] PATH_INFO: `/v3/users/glance` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:59.878875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032a589-d74c-48d7-9cc6-367507030edf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:59.881518 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032a589-d74c-48d7-9cc6-367507030edf None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:59.891570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d79c-755e-4c0a-b59c-85e395799c03 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-5032a589-d74c-48d7-9cc6-367507030edf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:17:59.901214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:59.902301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 289/583] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:59.908918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032a589-d74c-48d7-9cc6-367507030edf None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:17:59.943407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0c2f5-60c3-43da-93f2-1f52d0d82482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:17:59.944261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c2f5-60c3-43da-93f2-1f52d0d82482 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:17:59.944545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c2f5-60c3-43da-93f2-1f52d0d82482 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:17:59.944810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0c2f5-60c3-43da-93f2-1f52d0d82482 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:17:59.954305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0c2f5-60c3-43da-93f2-1f52d0d82482 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:17:59.956475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e0c2f5-60c3-43da-93f2-1f52d0d82482 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-65e0c2f5-60c3-43da-93f2-1f52d0d82482 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:17:59.979335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:17:59.980408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:17:59.981353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:17:59.981353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:17:59.981353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:17:59.981353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:17:59.981353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:17:59.981353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:17:59.981353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:17:59.981353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:17:59.981353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:17:59.981353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:17:59.986167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 295/584] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:17:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:17:59.992094 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0c2f5-60c3-43da-93f2-1f52d0d82482 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:00.022337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032a589-d74c-48d7-9cc6-367507030edf None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:00.083552 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd468e-a484-4d13-ad73-a0380656b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:00.084979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd468e-a484-4d13-ad73-a0380656b6fa None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:00.085636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd468e-a484-4d13-ad73-a0380656b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:00.085636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd468e-a484-4d13-ad73-a0380656b6fa None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:00.086801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd468e-a484-4d13-ad73-a0380656b6fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:00.087350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd468e-a484-4d13-ad73-a0380656b6fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:00.089855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd468e-a484-4d13-ad73-a0380656b6fa None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:00.105992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e0c2f5-60c3-43da-93f2-1f52d0d82482 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:00.115147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 290/585] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:00.115147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd468e-a484-4d13-ad73-a0380656b6fa None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:00.163313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f8a2-422d-463d-85ba-1cce6b32d9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:00.164056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f8a2-422d-463d-85ba-1cce6b32d9d1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:00.164341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f8a2-422d-463d-85ba-1cce6b32d9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:00.164602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3f8a2-422d-463d-85ba-1cce6b32d9d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:00.176964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3f8a2-422d-463d-85ba-1cce6b32d9d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:00.178436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3f8a2-422d-463d-85ba-1cce6b32d9d1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-f8f3f8a2-422d-463d-85ba-1cce6b32d9d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:00.201825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:00.202900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:00.204822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:00.204822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:00.204822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:00.204822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:00.204822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 296/586] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:00.204822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f8a2-422d-463d-85ba-1cce6b32d9d1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:00.252110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd468e-a484-4d13-ad73-a0380656b6fa None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:00.289958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd95648-bd3c-4fab-8662-ed2bfbabd770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:00.291007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd95648-bd3c-4fab-8662-ed2bfbabd770 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:00.291543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd95648-bd3c-4fab-8662-ed2bfbabd770 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:00.292062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd95648-bd3c-4fab-8662-ed2bfbabd770 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:00.293316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd95648-bd3c-4fab-8662-ed2bfbabd770 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:00.293830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd95648-bd3c-4fab-8662-ed2bfbabd770 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:00.297229 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd95648-bd3c-4fab-8662-ed2bfbabd770 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:00.318351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 291/587] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 12 14:18:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:00.319698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd95648-bd3c-4fab-8662-ed2bfbabd770 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:00.330102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3f8a2-422d-463d-85ba-1cce6b32d9d1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:00.371742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7806e13-2c4f-4c7f-8581-4fbbc2cfa840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:00.373062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806e13-2c4f-4c7f-8581-4fbbc2cfa840 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:00.373435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806e13-2c4f-4c7f-8581-4fbbc2cfa840 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:00.373722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7806e13-2c4f-4c7f-8581-4fbbc2cfa840 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:00.374596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7806e13-2c4f-4c7f-8581-4fbbc2cfa840 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:00.374912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7806e13-2c4f-4c7f-8581-4fbbc2cfa840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:00.376433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7806e13-2c4f-4c7f-8581-4fbbc2cfa840 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:00.405923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 297/588] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 12 14:18:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:00.405923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7806e13-2c4f-4c7f-8581-4fbbc2cfa840 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:00.433385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd95648-bd3c-4fab-8662-ed2bfbabd770 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:00.490304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d8ba3-e2e4-46e1-8fb2-09a014700e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:00.491830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d8ba3-e2e4-46e1-8fb2-09a014700e1d None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:00.492298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d8ba3-e2e4-46e1-8fb2-09a014700e1d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:00.492871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d8ba3-e2e4-46e1-8fb2-09a014700e1d None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/2366609a0a564e7fbcb05b503de78580/roles/74e0a16c92f749e793a06bd6cbb9b2b6` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:00.513977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d8ba3-e2e4-46e1-8fb2-09a014700e1d None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=2366609a0a564e7fbcb05b503de78580, role_id=74e0a16c92f749e793a06bd6cbb9b2b6)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:00.515522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d8ba3-e2e4-46e1-8fb2-09a014700e1d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:00.519562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7806e13-2c4f-4c7f-8581-4fbbc2cfa840 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:00.534698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 292/589] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:18:00 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/2366609a0a564e7fbcb05b503de78580/roles/74e0a16c92f749e793a06bd6cbb9b2b6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:18:00.535861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d8ba3-e2e4-46e1-8fb2-09a014700e1d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:00.577429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd8a5-f858-4999-b5d3-cb024704c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:00.578737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd8a5-f858-4999-b5d3-cb024704c928 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:00.579292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd8a5-f858-4999-b5d3-cb024704c928 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:00.579934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edd8a5-f858-4999-b5d3-cb024704c928 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:00.580953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edd8a5-f858-4999-b5d3-cb024704c928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:00.581491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edd8a5-f858-4999-b5d3-cb024704c928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:00.583389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edd8a5-f858-4999-b5d3-cb024704c928 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:00.602456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 298/590] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:00.603860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd8a5-f858-4999-b5d3-cb024704c928 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:00.656868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d8ba3-e2e4-46e1-8fb2-09a014700e1d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:00.697211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b7316-d4a4-4321-a414-9b3243b784f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:00.697970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7316-d4a4-4321-a414-9b3243b784f4 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:00.698257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7316-d4a4-4321-a414-9b3243b784f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:00.698540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7316-d4a4-4321-a414-9b3243b784f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:00.711684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b7316-d4a4-4321-a414-9b3243b784f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:00.713367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b7316-d4a4-4321-a414-9b3243b784f4 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:00.729737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edd8a5-f858-4999-b5d3-cb024704c928 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-ad6b7316-d4a4-4321-a414-9b3243b784f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:00.735769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:00.736756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:00.737683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:00.737683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:00.737683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:00.737683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:00.742133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 293/591] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:00.743227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b7316-d4a4-4321-a414-9b3243b784f4 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:00.775572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae960c-c8c0-4c44-abc1-13e242b1e24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:00.776841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae960c-c8c0-4c44-abc1-13e242b1e24b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:00.777347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae960c-c8c0-4c44-abc1-13e242b1e24b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:00.777901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae960c-c8c0-4c44-abc1-13e242b1e24b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:00.800478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae960c-c8c0-4c44-abc1-13e242b1e24b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:00.802453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae960c-c8c0-4c44-abc1-13e242b1e24b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-5dae960c-c8c0-4c44-abc1-13e242b1e24b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:00.825386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:00.827000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:00.828115 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:00.828115 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:00.828115 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:00.828115 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:00.830276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 299/592] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:00.835594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae960c-c8c0-4c44-abc1-13e242b1e24b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:00.889360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b7316-d4a4-4321-a414-9b3243b784f4 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:00.926431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c2795-4c51-4ec7-99a7-35a4b04e1c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:00.927472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c2795-4c51-4ec7-99a7-35a4b04e1c38 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:00.927865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c2795-4c51-4ec7-99a7-35a4b04e1c38 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:00.928251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c2795-4c51-4ec7-99a7-35a4b04e1c38 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:00.939176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c2795-4c51-4ec7-99a7-35a4b04e1c38 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:00.939176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c2795-4c51-4ec7-99a7-35a4b04e1c38 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c99c2795-4c51-4ec7-99a7-35a4b04e1c38 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:00.956321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:00.958295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:00.960026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:00.960026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:00.960026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:00.960026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:00.960026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:00.960026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:00.960026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:00.960026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:00.960026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:18:00.960026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:00.966138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 294/593] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:00.966138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c2795-4c51-4ec7-99a7-35a4b04e1c38 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:00.990543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae960c-c8c0-4c44-abc1-13e242b1e24b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:01.054700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417cf9c-8580-413a-951f-57e0fe6a8606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:01.055770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417cf9c-8580-413a-951f-57e0fe6a8606 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.056234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417cf9c-8580-413a-951f-57e0fe6a8606 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.056669 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417cf9c-8580-413a-951f-57e0fe6a8606 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.057877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417cf9c-8580-413a-951f-57e0fe6a8606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:01.058389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417cf9c-8580-413a-951f-57e0fe6a8606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:01.061379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417cf9c-8580-413a-951f-57e0fe6a8606 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:01.077059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c2795-4c51-4ec7-99a7-35a4b04e1c38 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:01.080657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 300/594] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:01.085184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417cf9c-8580-413a-951f-57e0fe6a8606 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:01.117421 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f6a35-546f-4cbb-93ec-0c5439627a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:01.118099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6a35-546f-4cbb-93ec-0c5439627a17 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.118390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6a35-546f-4cbb-93ec-0c5439627a17 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.118663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f6a35-546f-4cbb-93ec-0c5439627a17 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.119458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f6a35-546f-4cbb-93ec-0c5439627a17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:01.119768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f6a35-546f-4cbb-93ec-0c5439627a17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:01.121178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f6a35-546f-4cbb-93ec-0c5439627a17 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:01.134006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 295/595] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:01.135396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931a1df-82ee-4fb4-8346-a2e67bc2ff07 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.135688 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931a1df-82ee-4fb4-8346-a2e67bc2ff07 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.135967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931a1df-82ee-4fb4-8346-a2e67bc2ff07 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.141381 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 296/596] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:01.141381 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931a1df-82ee-4fb4-8346-a2e67bc2ff07 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:01.203114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417cf9c-8580-413a-951f-57e0fe6a8606 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:01.238455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333b9c-bed0-4232-b640-52d03eeeb36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:01.239082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333b9c-bed0-4232-b640-52d03eeeb36e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.239368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333b9c-bed0-4232-b640-52d03eeeb36e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.239643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce333b9c-bed0-4232-b640-52d03eeeb36e None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.240504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce333b9c-bed0-4232-b640-52d03eeeb36e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:01.240817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce333b9c-bed0-4232-b640-52d03eeeb36e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:01.242279 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce333b9c-bed0-4232-b640-52d03eeeb36e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:01.248059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931a1df-82ee-4fb4-8346-a2e67bc2ff07 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:01.265042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 301/597] 10.222.0.75 () {56 vars in 1139 bytes} [Thu May 12 14:18:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:01.265042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333b9c-bed0-4232-b640-52d03eeeb36e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:01.289032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f06cfd-b62f-4c9b-82ac-bcf4f7b336c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:01.290023 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06cfd-b62f-4c9b-82ac-bcf4f7b336c7 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.290380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06cfd-b62f-4c9b-82ac-bcf4f7b336c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.290729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06cfd-b62f-4c9b-82ac-bcf4f7b336c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.309959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f06cfd-b62f-4c9b-82ac-bcf4f7b336c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:01.311583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f06cfd-b62f-4c9b-82ac-bcf4f7b336c7 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-40f06cfd-b62f-4c9b-82ac-bcf4f7b336c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:01.326706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:01.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:01.329025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:01.329025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:01.329025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:01.329025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:01.329025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:01.329025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:01.329025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:01.329025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:01.329025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 297/598] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:01.329524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97f78-93e3-40ac-94bc-8d2465016699 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.330044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97f78-93e3-40ac-94bc-8d2465016699 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.330044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97f78-93e3-40ac-94bc-8d2465016699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.348406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-aee97f78-93e3-40ac-94bc-8d2465016699 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:01.349634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-aee97f78-93e3-40ac-94bc-8d2465016699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:01.385100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce333b9c-bed0-4232-b640-52d03eeeb36e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:01.439066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 298/599] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:01.440335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee97f78-93e3-40ac-94bc-8d2465016699 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:01.456980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d406e-1b78-4383-94c8-6eb8b52890eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:01.458747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d406e-1b78-4383-94c8-6eb8b52890eb None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.459888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d406e-1b78-4383-94c8-6eb8b52890eb None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.460931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d406e-1b78-4383-94c8-6eb8b52890eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.469841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d406e-1b78-4383-94c8-6eb8b52890eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:01.471357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d406e-1b78-4383-94c8-6eb8b52890eb None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-fe2d406e-1b78-4383-94c8-6eb8b52890eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:01.487564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:01.488738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:01.497389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:01.497389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:01.497389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:01.497389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:01.497389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:01.497389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:01.497389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:01.497389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:01.497389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 302/600] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:01.497389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d406e-1b78-4383-94c8-6eb8b52890eb None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:01.595981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee97f78-93e3-40ac-94bc-8d2465016699 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:01.632088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d406e-1b78-4383-94c8-6eb8b52890eb None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:01.649527 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3026a2-8c1b-4c77-82d8-2fac91c16767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:01.650885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3026a2-8c1b-4c77-82d8-2fac91c16767 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.651407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3026a2-8c1b-4c77-82d8-2fac91c16767 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.651904 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3026a2-8c1b-4c77-82d8-2fac91c16767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.666630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3026a2-8c1b-4c77-82d8-2fac91c16767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:01.669339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3026a2-8c1b-4c77-82d8-2fac91c16767 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:01.673126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd67a1f-b893-4d9a-aa75-c94e97a60f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:01.673924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd67a1f-b893-4d9a-aa75-c94e97a60f4c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.674463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd67a1f-b893-4d9a-aa75-c94e97a60f4c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.674874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd67a1f-b893-4d9a-aa75-c94e97a60f4c None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.675863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd67a1f-b893-4d9a-aa75-c94e97a60f4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:01.676311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd67a1f-b893-4d9a-aa75-c94e97a60f4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:01.678123 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd67a1f-b893-4d9a-aa75-c94e97a60f4c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-6f3026a2-8c1b-4c77-82d8-2fac91c16767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:01.691088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:01.693033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:01.694959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:01.694959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:01.694959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:01.694959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:01.698945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 299/602] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:01.699340 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 303/602] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:01.699993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3026a2-8c1b-4c77-82d8-2fac91c16767 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:01.700249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd67a1f-b893-4d9a-aa75-c94e97a60f4c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:01.847004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd67a1f-b893-4d9a-aa75-c94e97a60f4c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:01.857794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3026a2-8c1b-4c77-82d8-2fac91c16767 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:01.890045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6b864-a248-4b17-b631-dfbb69917f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:01.890727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6b864-a248-4b17-b631-dfbb69917f5f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.891013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6b864-a248-4b17-b631-dfbb69917f5f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.891317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6b864-a248-4b17-b631-dfbb69917f5f None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.892129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6b864-a248-4b17-b631-dfbb69917f5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:01.892438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6b864-a248-4b17-b631-dfbb69917f5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:01.893889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc6b864-a248-4b17-b631-dfbb69917f5f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:01.911544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a949054-3517-4063-9dcb-7ca60ea04338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:01.912352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a949054-3517-4063-9dcb-7ca60ea04338 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:01.912635 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a949054-3517-4063-9dcb-7ca60ea04338 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:01.912914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a949054-3517-4063-9dcb-7ca60ea04338 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:01.921327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 304/603] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:01.921327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6b864-a248-4b17-b631-dfbb69917f5f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:01.930186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a949054-3517-4063-9dcb-7ca60ea04338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-5a949054-3517-4063-9dcb-7ca60ea04338 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:01.942658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:01.944818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 300/604] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:01.946476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a949054-3517-4063-9dcb-7ca60ea04338 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:02.039651 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6b864-a248-4b17-b631-dfbb69917f5f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:02.073643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a949054-3517-4063-9dcb-7ca60ea04338 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:02.077019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63267207-c813-4b32-9158-cc2de33ccccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:02.078128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63267207-c813-4b32-9158-cc2de33ccccf None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:02.078630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63267207-c813-4b32-9158-cc2de33ccccf None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:02.079178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63267207-c813-4b32-9158-cc2de33ccccf None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:02.080030 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63267207-c813-4b32-9158-cc2de33ccccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:02.080350 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63267207-c813-4b32-9158-cc2de33ccccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:02.081746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63267207-c813-4b32-9158-cc2de33ccccf None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:02.102090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 305/605] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:02.102090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63267207-c813-4b32-9158-cc2de33ccccf None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:02.111143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cc6fa-0ee2-485e-86bf-ce3e84f37234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:02.112043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc6fa-0ee2-485e-86bf-ce3e84f37234 None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:02.112329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc6fa-0ee2-485e-86bf-ce3e84f37234 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:02.112618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cc6fa-0ee2-485e-86bf-ce3e84f37234 None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/10414e35df26406786eaf49c52661cee/roles/74e0a16c92f749e793a06bd6cbb9b2b6` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:02.134888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cc6fa-0ee2-485e-86bf-ce3e84f37234 None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=10414e35df26406786eaf49c52661cee, role_id=74e0a16c92f749e793a06bd6cbb9b2b6)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:02.136417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cc6fa-0ee2-485e-86bf-ce3e84f37234 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:02.152981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 301/606] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:18:01 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/10414e35df26406786eaf49c52661cee/roles/74e0a16c92f749e793a06bd6cbb9b2b6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:18:02.153528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cc6fa-0ee2-485e-86bf-ce3e84f37234 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:02.243661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63267207-c813-4b32-9158-cc2de33ccccf None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:02.273201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cc6fa-0ee2-485e-86bf-ce3e84f37234 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:02.293053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9a281-ed11-4e73-8529-cfeb5213142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:02.294887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a281-ed11-4e73-8529-cfeb5213142a None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:02.295410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a281-ed11-4e73-8529-cfeb5213142a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:02.296051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad9a281-ed11-4e73-8529-cfeb5213142a None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/cbe18e038b414ef0956a4e8a86586b88/roles/74e0a16c92f749e793a06bd6cbb9b2b6` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:02.321734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9a281-ed11-4e73-8529-cfeb5213142a None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=cbe18e038b414ef0956a4e8a86586b88, role_id=74e0a16c92f749e793a06bd6cbb9b2b6)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:02.328097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad9a281-ed11-4e73-8529-cfeb5213142a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:02.334054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f74d0-561f-433e-9481-87061358c528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:02.335451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f74d0-561f-433e-9481-87061358c528 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:02.335981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f74d0-561f-433e-9481-87061358c528 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:02.336138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f74d0-561f-433e-9481-87061358c528 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:02.339093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f74d0-561f-433e-9481-87061358c528 None admin] RBAC: Adding query filter params (name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:02.339093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f74d0-561f-433e-9481-87061358c528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:02.341882 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f74d0-561f-433e-9481-87061358c528 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:02.362835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 306/607] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:18:02 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/cbe18e038b414ef0956a4e8a86586b88/roles/74e0a16c92f749e793a06bd6cbb9b2b6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:18:02.362835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9a281-ed11-4e73-8529-cfeb5213142a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:02.371621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 302/608] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:18:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:02.373850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f74d0-561f-433e-9481-87061358c528 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:02.493138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f74d0-561f-433e-9481-87061358c528 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:02.506495 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad9a281-ed11-4e73-8529-cfeb5213142a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:02.533600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901d941-9053-468f-b194-5571e8c19bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:02.534738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d941-9053-468f-b194-5571e8c19bdf None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:02.535220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d941-9053-468f-b194-5571e8c19bdf None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:02.535737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901d941-9053-468f-b194-5571e8c19bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:02.547758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b86bbf-f728-43c8-b730-3473a30f2953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:02.548670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b86bbf-f728-43c8-b730-3473a30f2953 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:02.549122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b86bbf-f728-43c8-b730-3473a30f2953 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:02.549428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b86bbf-f728-43c8-b730-3473a30f2953 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:02.550201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901d941-9053-468f-b194-5571e8c19bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:02.552101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901d941-9053-468f-b194-5571e8c19bdf None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:02.559305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b86bbf-f728-43c8-b730-3473a30f2953 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:02.561183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b86bbf-f728-43c8-b730-3473a30f2953 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-20b86bbf-f728-43c8-b730-3473a30f2953 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:02.576907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:02.578718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:02.580571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:02.580571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:02.580571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:02.580571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:02.580571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:02.580571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:02.580571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:02.580571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:02.583015 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 307/609] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:02.584734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b86bbf-f728-43c8-b730-3473a30f2953 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-b901d941-9053-468f-b194-5571e8c19bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:02.589608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:02.590742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:02.592779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:02.592779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:02.592779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:02.592779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:02.596128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 303/610] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:02.602021 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901d941-9053-468f-b194-5571e8c19bdf None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:02.708883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b86bbf-f728-43c8-b730-3473a30f2953 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:02.729174 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901d941-9053-468f-b194-5571e8c19bdf None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:02.746951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc5ce7-0be3-4e3d-ad6b-bfd7e3481c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:02.747684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc5ce7-0be3-4e3d-ad6b-bfd7e3481c48 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:02.747969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc5ce7-0be3-4e3d-ad6b-bfd7e3481c48 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:02.748246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc5ce7-0be3-4e3d-ad6b-bfd7e3481c48 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:02.749045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc5ce7-0be3-4e3d-ad6b-bfd7e3481c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:02.749359 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc5ce7-0be3-4e3d-ad6b-bfd7e3481c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:02.751070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc5ce7-0be3-4e3d-ad6b-bfd7e3481c48 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:02.766278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 308/611] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:02.769610 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafa13e-2182-4856-9f84-15ec32ccde1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:02.770431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc5ce7-0be3-4e3d-ad6b-bfd7e3481c48 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:02.771103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa13e-2182-4856-9f84-15ec32ccde1f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:02.771618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa13e-2182-4856-9f84-15ec32ccde1f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:02.772101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa13e-2182-4856-9f84-15ec32ccde1f None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:02.773050 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafa13e-2182-4856-9f84-15ec32ccde1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:02.773580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafa13e-2182-4856-9f84-15ec32ccde1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:02.775226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafa13e-2182-4856-9f84-15ec32ccde1f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:02.789615 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 304/612] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:02.796204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafa13e-2182-4856-9f84-15ec32ccde1f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:02.880383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc5ce7-0be3-4e3d-ad6b-bfd7e3481c48 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:02.903855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafa13e-2182-4856-9f84-15ec32ccde1f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:02.916487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8e040-5159-4486-a34f-b64ccc80c351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:02.917405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8e040-5159-4486-a34f-b64ccc80c351 None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:02.917660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8e040-5159-4486-a34f-b64ccc80c351 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:02.917932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8e040-5159-4486-a34f-b64ccc80c351 None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/5aca248c2e074fc4baff39930e21fe29/roles/74e0a16c92f749e793a06bd6cbb9b2b6` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:02.933955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8e040-5159-4486-a34f-b64ccc80c351 None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=5aca248c2e074fc4baff39930e21fe29, role_id=74e0a16c92f749e793a06bd6cbb9b2b6)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:02.936127 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8e040-5159-4486-a34f-b64ccc80c351 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:02.943890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03befa6f-f047-4343-95c4-878a1f3f8616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:02.945048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03befa6f-f047-4343-95c4-878a1f3f8616 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:02.945539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03befa6f-f047-4343-95c4-878a1f3f8616 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:02.946010 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03befa6f-f047-4343-95c4-878a1f3f8616 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:02.955207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03befa6f-f047-4343-95c4-878a1f3f8616 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:02.957135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03befa6f-f047-4343-95c4-878a1f3f8616 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:02.958354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 309/613] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:18:02 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/5aca248c2e074fc4baff39930e21fe29/roles/74e0a16c92f749e793a06bd6cbb9b2b6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-03befa6f-f047-4343-95c4-878a1f3f8616 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:02.976609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:02.977746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:02.978701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:02.978701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:02.978701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:02.978701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:02.978701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:02.978701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:02.978701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:02.978701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:02.978701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:18:02.978701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:02.981789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 305/614] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:02.988573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8e040-5159-4486-a34f-b64ccc80c351 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:03.126360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8e040-5159-4486-a34f-b64ccc80c351 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:03.165087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad4769-44f8-44e3-9344-67826d9fcfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:03.165774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad4769-44f8-44e3-9344-67826d9fcfdb None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:03.166055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad4769-44f8-44e3-9344-67826d9fcfdb None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:03.166332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad4769-44f8-44e3-9344-67826d9fcfdb None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:03.167217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad4769-44f8-44e3-9344-67826d9fcfdb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:03.167528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad4769-44f8-44e3-9344-67826d9fcfdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:03.169003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad4769-44f8-44e3-9344-67826d9fcfdb None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:03.195069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 310/615] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 12 14:18:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:03.201667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03befa6f-f047-4343-95c4-878a1f3f8616 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:03.213167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064643ca-5ced-45a2-99f3-6fbc15267a75 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:03.213576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064643ca-5ced-45a2-99f3-6fbc15267a75 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:03.213860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064643ca-5ced-45a2-99f3-6fbc15267a75 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:03.215921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 311/616] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:03.225192 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c525d6a-e2e6-4b18-9436-bdf982e1b9f3 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:03.225637 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c525d6a-e2e6-4b18-9436-bdf982e1b9f3 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:03.226025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c525d6a-e2e6-4b18-9436-bdf982e1b9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:03.244500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-8c525d6a-e2e6-4b18-9436-bdf982e1b9f3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:03.245863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8c525d6a-e2e6-4b18-9436-bdf982e1b9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:03.327154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 312/617] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:03.331413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03befa6f-f047-4343-95c4-878a1f3f8616 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:03.349371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c525d6a-e2e6-4b18-9436-bdf982e1b9f3 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:03.366845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105658f1-928b-45f4-9e91-0b83ef9824a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:03.367684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105658f1-928b-45f4-9e91-0b83ef9824a4 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:03.367970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105658f1-928b-45f4-9e91-0b83ef9824a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:03.368242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105658f1-928b-45f4-9e91-0b83ef9824a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:03.381465 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105658f1-928b-45f4-9e91-0b83ef9824a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:03.382932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105658f1-928b-45f4-9e91-0b83ef9824a4 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-105658f1-928b-45f4-9e91-0b83ef9824a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:03.401131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:03.402214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:03.403349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:03.403349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:03.403349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:03.403349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:03.403349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 306/618] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:03.412091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105658f1-928b-45f4-9e91-0b83ef9824a4 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:03.465392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c525d6a-e2e6-4b18-9436-bdf982e1b9f3 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:03.517294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354673b-60fb-4516-9b32-e7d2ffed09ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:03.518339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354673b-60fb-4516-9b32-e7d2ffed09ba None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:03.518779 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354673b-60fb-4516-9b32-e7d2ffed09ba None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:03.519238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354673b-60fb-4516-9b32-e7d2ffed09ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:03.541861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105658f1-928b-45f4-9e91-0b83ef9824a4 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:03.544081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354673b-60fb-4516-9b32-e7d2ffed09ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-9354673b-60fb-4516-9b32-e7d2ffed09ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:03.560373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:03.561507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:03.562556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:03.566445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 313/619] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:03.569537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354673b-60fb-4516-9b32-e7d2ffed09ba None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:03.580545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436de53-ae2f-4615-a9b5-2a1b7d258fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:03.581395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436de53-ae2f-4615-a9b5-2a1b7d258fdf None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:03.581777 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436de53-ae2f-4615-a9b5-2a1b7d258fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:03.582149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436de53-ae2f-4615-a9b5-2a1b7d258fdf None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:03.582985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436de53-ae2f-4615-a9b5-2a1b7d258fdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:03.583421 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436de53-ae2f-4615-a9b5-2a1b7d258fdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:03.584894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436de53-ae2f-4615-a9b5-2a1b7d258fdf None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:03.597865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 307/620] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:03.603309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436de53-ae2f-4615-a9b5-2a1b7d258fdf None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:03.719741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436de53-ae2f-4615-a9b5-2a1b7d258fdf None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:03.770600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0289-2b95-4afc-a3d2-afc332029800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:03.771907 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0289-2b95-4afc-a3d2-afc332029800 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:03.772370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0289-2b95-4afc-a3d2-afc332029800 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:03.772793 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b0289-2b95-4afc-a3d2-afc332029800 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:03.783454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b0289-2b95-4afc-a3d2-afc332029800 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:03.787778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b0289-2b95-4afc-a3d2-afc332029800 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-a60b0289-2b95-4afc-a3d2-afc332029800 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:03.808889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:03.810575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:03.811738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:03.811738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:03.811738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:03.811738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:03.811738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:03.811738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:03.811738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:03.811738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:03.817584 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354673b-60fb-4516-9b32-e7d2ffed09ba None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:03.830483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 308/621] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:03.831708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0289-2b95-4afc-a3d2-afc332029800 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:03.886794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87f825-241b-40db-96b2-97559fd1a92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:03.887760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87f825-241b-40db-96b2-97559fd1a92a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:03.888396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87f825-241b-40db-96b2-97559fd1a92a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:03.888540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87f825-241b-40db-96b2-97559fd1a92a None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:03.889914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87f825-241b-40db-96b2-97559fd1a92a None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:03.890604 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87f825-241b-40db-96b2-97559fd1a92a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:03.893340 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87f825-241b-40db-96b2-97559fd1a92a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:03.911447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 314/622] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:18:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:03.917292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87f825-241b-40db-96b2-97559fd1a92a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:03.950292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b0289-2b95-4afc-a3d2-afc332029800 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:03.991804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae75954-59ea-4d3d-ae4c-c5b54ad51028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:03.992496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75954-59ea-4d3d-ae4c-c5b54ad51028 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:03.992783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75954-59ea-4d3d-ae4c-c5b54ad51028 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:03.993062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75954-59ea-4d3d-ae4c-c5b54ad51028 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:03.993874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae75954-59ea-4d3d-ae4c-c5b54ad51028 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:03.994190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae75954-59ea-4d3d-ae4c-c5b54ad51028 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:03.995710 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae75954-59ea-4d3d-ae4c-c5b54ad51028 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:04.025061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87f825-241b-40db-96b2-97559fd1a92a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:04.025762 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 309/623] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:04.030979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae75954-59ea-4d3d-ae4c-c5b54ad51028 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:04.062080 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde8f9-47df-45af-9972-cce87cd095e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:04.063076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde8f9-47df-45af-9972-cce87cd095e3 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:04.063463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde8f9-47df-45af-9972-cce87cd095e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:04.063829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde8f9-47df-45af-9972-cce87cd095e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:04.075439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebde8f9-47df-45af-9972-cce87cd095e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:04.078138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebde8f9-47df-45af-9972-cce87cd095e3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-8ebde8f9-47df-45af-9972-cce87cd095e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:04.097074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:04.098996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:04.101053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:04.101053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:04.101053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:04.101053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:04.101501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 315/624] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:04.112875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde8f9-47df-45af-9972-cce87cd095e3 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:04.181680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae75954-59ea-4d3d-ae4c-c5b54ad51028 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:04.225174 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318b620-9a3d-4df1-9877-70167e14254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:04.226077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318b620-9a3d-4df1-9877-70167e14254b None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:04.226367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318b620-9a3d-4df1-9877-70167e14254b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:04.226650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318b620-9a3d-4df1-9877-70167e14254b None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/2893125208864a1ab2c32e50d5da3f83/roles/74e0a16c92f749e793a06bd6cbb9b2b6` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:04.256417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318b620-9a3d-4df1-9877-70167e14254b None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=2893125208864a1ab2c32e50d5da3f83, role_id=74e0a16c92f749e793a06bd6cbb9b2b6)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:04.257314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde8f9-47df-45af-9972-cce87cd095e3 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:04.258012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318b620-9a3d-4df1-9877-70167e14254b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:04.289483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 310/625] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:18:04 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/2893125208864a1ab2c32e50d5da3f83/roles/74e0a16c92f749e793a06bd6cbb9b2b6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:18:04.295186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210f17-054e-4ac6-a0e5-f641fccbb94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:04.296066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210f17-054e-4ac6-a0e5-f641fccbb94e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:04.296455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210f17-054e-4ac6-a0e5-f641fccbb94e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:04.296837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20210f17-054e-4ac6-a0e5-f641fccbb94e None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:04.297710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20210f17-054e-4ac6-a0e5-f641fccbb94e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:04.298174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20210f17-054e-4ac6-a0e5-f641fccbb94e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:04.299739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20210f17-054e-4ac6-a0e5-f641fccbb94e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:04.314626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 316/626] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:04.320297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318b620-9a3d-4df1-9877-70167e14254b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:04.460394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318b620-9a3d-4df1-9877-70167e14254b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:04.508901 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef461-ea9c-4966-9e2c-c3b34861b411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:04.509719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef461-ea9c-4966-9e2c-c3b34861b411 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:04.510004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef461-ea9c-4966-9e2c-c3b34861b411 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:04.510280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef461-ea9c-4966-9e2c-c3b34861b411 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:04.523917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ef461-ea9c-4966-9e2c-c3b34861b411 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:04.525449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ef461-ea9c-4966-9e2c-c3b34861b411 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-797ef461-ea9c-4966-9e2c-c3b34861b411 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:04.547712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:04.550039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:04.552462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 311/627] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 12 14:18:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:04.559054 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210f17-054e-4ac6-a0e5-f641fccbb94e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:04.712906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20210f17-054e-4ac6-a0e5-f641fccbb94e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:04.758626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872f16e-6075-408e-b93b-4dd8b72835cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:04.759380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872f16e-6075-408e-b93b-4dd8b72835cf None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:04.759691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872f16e-6075-408e-b93b-4dd8b72835cf None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:04.759973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872f16e-6075-408e-b93b-4dd8b72835cf None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:04.760836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872f16e-6075-408e-b93b-4dd8b72835cf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:04.761153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872f16e-6075-408e-b93b-4dd8b72835cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:04.762595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872f16e-6075-408e-b93b-4dd8b72835cf None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:04.795790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 317/628] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 12 14:18:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:04.801577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef461-ea9c-4966-9e2c-c3b34861b411 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:04.944934 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef461-ea9c-4966-9e2c-c3b34861b411 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:04.997328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a99295-2263-48e9-bda3-138ddba26638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:04.998216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a99295-2263-48e9-bda3-138ddba26638 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:04.998576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a99295-2263-48e9-bda3-138ddba26638 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:04.998857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a99295-2263-48e9-bda3-138ddba26638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:05.085895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a99295-2263-48e9-bda3-138ddba26638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:05.087405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a99295-2263-48e9-bda3-138ddba26638 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:05.190904 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 312/629] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:18:05.196731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872f16e-6075-408e-b93b-4dd8b72835cf None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:05.370110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872f16e-6075-408e-b93b-4dd8b72835cf None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:05.418886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24168342-5a05-4349-8e46-de6abcdf6b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:05.419775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24168342-5a05-4349-8e46-de6abcdf6b05 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:05.420060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24168342-5a05-4349-8e46-de6abcdf6b05 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:05.420337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24168342-5a05-4349-8e46-de6abcdf6b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:05.436451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24168342-5a05-4349-8e46-de6abcdf6b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:05.437930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24168342-5a05-4349-8e46-de6abcdf6b05 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:05.444919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e60d-daa9-4dd0-a18c-082f2ea328c8 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:05.445210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e60d-daa9-4dd0-a18c-082f2ea328c8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:05.445480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e60d-daa9-4dd0-a18c-082f2ea328c8 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:05.447132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 313/630] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:05.453235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b93a-1014-4b30-b480-448f7c82272c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:05.453512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b93a-1014-4b30-b480-448f7c82272c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:05.453802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b93a-1014-4b30-b480-448f7c82272c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-24168342-5a05-4349-8e46-de6abcdf6b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:05.464451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:05.467284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:05.469529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:05.469529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:05.469529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:05.469529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:05.469529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 318/631] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:05.474144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24168342-5a05-4349-8e46-de6abcdf6b05 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:05.477402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-7515b93a-1014-4b30-b480-448f7c82272c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:05.478622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7515b93a-1014-4b30-b480-448f7c82272c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:05.563294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 314/632] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:18:05.564890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021298-71ae-4987-beb6-ad95a9bec5af None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:05.565189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021298-71ae-4987-beb6-ad95a9bec5af None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:05.565469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021298-71ae-4987-beb6-ad95a9bec5af None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:05.567306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 315/633] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:05.572744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df362a86-6778-4b18-8b06-fae9770da977 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:05.573127 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df362a86-6778-4b18-8b06-fae9770da977 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:05.573746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df362a86-6778-4b18-8b06-fae9770da977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:05.594385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-df362a86-6778-4b18-8b06-fae9770da977 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:05.595649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-df362a86-6778-4b18-8b06-fae9770da977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:05.624500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24168342-5a05-4349-8e46-de6abcdf6b05 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:05.676282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddc7f8-6716-4e4e-b207-704eb666bc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:05.677164 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddc7f8-6716-4e4e-b207-704eb666bc9c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:05.677456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddc7f8-6716-4e4e-b207-704eb666bc9c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:05.677738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddc7f8-6716-4e4e-b207-704eb666bc9c None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:05.678492 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddc7f8-6716-4e4e-b207-704eb666bc9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:05.680848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddc7f8-6716-4e4e-b207-704eb666bc9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:05.682526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddc7f8-6716-4e4e-b207-704eb666bc9c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:05.686827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 316/634] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:05.687952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df362a86-6778-4b18-8b06-fae9770da977 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:05.703721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 319/635] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:05.715302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddc7f8-6716-4e4e-b207-704eb666bc9c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:05.817363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddc7f8-6716-4e4e-b207-704eb666bc9c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:05.821394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df362a86-6778-4b18-8b06-fae9770da977 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:05.852987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283390b-7af6-48a3-88dc-7ea20d975b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:05.853903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283390b-7af6-48a3-88dc-7ea20d975b55 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:05.854189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283390b-7af6-48a3-88dc-7ea20d975b55 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:05.854469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7283390b-7af6-48a3-88dc-7ea20d975b55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:05.858225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959a375-427a-40c9-9a18-b8ffdb0ce9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:05.860070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959a375-427a-40c9-9a18-b8ffdb0ce9cc None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:05.860785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959a375-427a-40c9-9a18-b8ffdb0ce9cc None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:05.861555 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959a375-427a-40c9-9a18-b8ffdb0ce9cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:05.865103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7283390b-7af6-48a3-88dc-7ea20d975b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-7283390b-7af6-48a3-88dc-7ea20d975b55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:05.873334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:05.874385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:05.875328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:05.875999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959a375-427a-40c9-9a18-b8ffdb0ce9cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:05.879479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 320/636] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:05.880260 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283390b-7af6-48a3-88dc-7ea20d975b55 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-3959a375-427a-40c9-9a18-b8ffdb0ce9cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:05.883061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:05.890556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 317/637] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:05.891998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19080c2f-315b-40bb-baa6-138a99bccab0 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:05.894029 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19080c2f-315b-40bb-baa6-138a99bccab0 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:05.894029 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19080c2f-315b-40bb-baa6-138a99bccab0 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:05.894029 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 318/638] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:05.894029 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19080c2f-315b-40bb-baa6-138a99bccab0 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:05.996125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19080c2f-315b-40bb-baa6-138a99bccab0 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:06.008943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7283390b-7af6-48a3-88dc-7ea20d975b55 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:06.035486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75e47e-b458-448e-8f9b-2d63c6291480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:06.036165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75e47e-b458-448e-8f9b-2d63c6291480 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.036449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75e47e-b458-448e-8f9b-2d63c6291480 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.036726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75e47e-b458-448e-8f9b-2d63c6291480 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.037484 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75e47e-b458-448e-8f9b-2d63c6291480 None admin] RBAC: Adding query filter params (name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:06.037793 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75e47e-b458-448e-8f9b-2d63c6291480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:06.039205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75e47e-b458-448e-8f9b-2d63c6291480 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:06.046388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b8683-7631-4ca4-9e8a-fdab2152057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:06.047362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b8683-7631-4ca4-9e8a-fdab2152057a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.047648 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b8683-7631-4ca4-9e8a-fdab2152057a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.048103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 319/639] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:18:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:06.048939 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75e47e-b458-448e-8f9b-2d63c6291480 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:06.051252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b8683-7631-4ca4-9e8a-fdab2152057a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.061138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b8683-7631-4ca4-9e8a-fdab2152057a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:06.063272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b8683-7631-4ca4-9e8a-fdab2152057a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-f95b8683-7631-4ca4-9e8a-fdab2152057a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:06.082413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:06.083446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 321/640] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f4ee-6abc-4069-bc65-4083ecf6550b None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.091747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f4ee-6abc-4069-bc65-4083ecf6550b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.093067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613f4ee-6abc-4069-bc65-4083ecf6550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.113726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-0613f4ee-6abc-4069-bc65-4083ecf6550b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:06.115112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0613f4ee-6abc-4069-bc65-4083ecf6550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:06.175761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75e47e-b458-448e-8f9b-2d63c6291480 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:06.182951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 322/641] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:06.183860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f4ee-6abc-4069-bc65-4083ecf6550b None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:06.222014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51b5b7-620a-43f6-8f4f-bcbed7b7f6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:06.222693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51b5b7-620a-43f6-8f4f-bcbed7b7f6b8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.222977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51b5b7-620a-43f6-8f4f-bcbed7b7f6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.223297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51b5b7-620a-43f6-8f4f-bcbed7b7f6b8 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.224058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51b5b7-620a-43f6-8f4f-bcbed7b7f6b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:06.224367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51b5b7-620a-43f6-8f4f-bcbed7b7f6b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:06.225760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51b5b7-620a-43f6-8f4f-bcbed7b7f6b8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:06.239112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 320/642] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:18:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:06.239112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51b5b7-620a-43f6-8f4f-bcbed7b7f6b8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:06.290516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613f4ee-6abc-4069-bc65-4083ecf6550b None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:06.327042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0d86e-ab9e-46c5-b334-e2ede7539483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:06.327861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0d86e-ab9e-46c5-b334-e2ede7539483 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.328148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0d86e-ab9e-46c5-b334-e2ede7539483 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.328426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0d86e-ab9e-46c5-b334-e2ede7539483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.339837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0d86e-ab9e-46c5-b334-e2ede7539483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:06.341887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0d86e-ab9e-46c5-b334-e2ede7539483 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:06.359544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51b5b7-620a-43f6-8f4f-bcbed7b7f6b8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-a9a0d86e-ab9e-46c5-b334-e2ede7539483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:06.362113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:06.369226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:06.371563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:06.371563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:06.371563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:06.371563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:06.371563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 323/643] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:06.371563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0d86e-ab9e-46c5-b334-e2ede7539483 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:06.421607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221ef12-5915-47d9-901d-3e1f8d45d029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:06.422481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221ef12-5915-47d9-901d-3e1f8d45d029 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.422874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221ef12-5915-47d9-901d-3e1f8d45d029 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.423255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221ef12-5915-47d9-901d-3e1f8d45d029 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.424136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221ef12-5915-47d9-901d-3e1f8d45d029 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:06.424523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221ef12-5915-47d9-901d-3e1f8d45d029 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:06.426116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221ef12-5915-47d9-901d-3e1f8d45d029 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:06.451603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 321/644] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:06.451603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221ef12-5915-47d9-901d-3e1f8d45d029 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:06.509439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0d86e-ab9e-46c5-b334-e2ede7539483 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:06.546408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767a5a-bc59-4029-9e74-acbf9a80c364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:06.547586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767a5a-bc59-4029-9e74-acbf9a80c364 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.547873 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767a5a-bc59-4029-9e74-acbf9a80c364 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.548155 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767a5a-bc59-4029-9e74-acbf9a80c364 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.558913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221ef12-5915-47d9-901d-3e1f8d45d029 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:06.562023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a767a5a-bc59-4029-9e74-acbf9a80c364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-8a767a5a-bc59-4029-9e74-acbf9a80c364 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:06.570399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:06.571501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:06.572427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 324/645] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:06.573163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767a5a-bc59-4029-9e74-acbf9a80c364 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:06.600563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f63fe2-038b-4c62-87f0-b89343c15527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:06.601779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63fe2-038b-4c62-87f0-b89343c15527 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.602165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63fe2-038b-4c62-87f0-b89343c15527 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.602447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63fe2-038b-4c62-87f0-b89343c15527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.624125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f63fe2-038b-4c62-87f0-b89343c15527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:06.625715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f63fe2-038b-4c62-87f0-b89343c15527 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c4f63fe2-038b-4c62-87f0-b89343c15527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:06.644576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:06.646157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:06.647284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:06.647284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:06.647284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:06.647284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:06.647284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 322/646] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:06.647284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f63fe2-038b-4c62-87f0-b89343c15527 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:06.710085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767a5a-bc59-4029-9e74-acbf9a80c364 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:06.756777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28e45e-ca6e-4708-8ee3-e05e44404f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:06.757751 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28e45e-ca6e-4708-8ee3-e05e44404f80 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.758209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28e45e-ca6e-4708-8ee3-e05e44404f80 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.758731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28e45e-ca6e-4708-8ee3-e05e44404f80 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.759731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28e45e-ca6e-4708-8ee3-e05e44404f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:06.760230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28e45e-ca6e-4708-8ee3-e05e44404f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:06.761666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28e45e-ca6e-4708-8ee3-e05e44404f80 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:06.783062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 325/647] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:06.783062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28e45e-ca6e-4708-8ee3-e05e44404f80 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:06.802484 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f63fe2-038b-4c62-87f0-b89343c15527 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:06.838474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89be8f3-c8a7-483e-9659-889d6fea687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:06.839427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89be8f3-c8a7-483e-9659-889d6fea687d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.839714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89be8f3-c8a7-483e-9659-889d6fea687d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.839998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89be8f3-c8a7-483e-9659-889d6fea687d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.840840 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89be8f3-c8a7-483e-9659-889d6fea687d None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=2366609a0a564e7fbcb05b503de78580) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:06.841156 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89be8f3-c8a7-483e-9659-889d6fea687d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:06.842618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89be8f3-c8a7-483e-9659-889d6fea687d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:06.849403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 323/648] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:06 2022] GET /identity/v3/role_assignments?user.id=2366609a0a564e7fbcb05b503de78580&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:06.850066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89be8f3-c8a7-483e-9659-889d6fea687d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:06.897028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28e45e-ca6e-4708-8ee3-e05e44404f80 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:06.935559 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8b0e2-a198-492d-a7e9-603acf9f41a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:06.936258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8b0e2-a198-492d-a7e9-603acf9f41a5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:06.936543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8b0e2-a198-492d-a7e9-603acf9f41a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:06.936824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8b0e2-a198-492d-a7e9-603acf9f41a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:06.937605 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8b0e2-a198-492d-a7e9-603acf9f41a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:06.937916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8b0e2-a198-492d-a7e9-603acf9f41a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:06.939347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8b0e2-a198-492d-a7e9-603acf9f41a5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:06.957915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 326/649] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:18:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:06.958827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8b0e2-a198-492d-a7e9-603acf9f41a5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:07.006678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89be8f3-c8a7-483e-9659-889d6fea687d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:07.046392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d424fb-2ec3-411d-8089-679cb2c46e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:07.047471 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d424fb-2ec3-411d-8089-679cb2c46e8c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.047913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d424fb-2ec3-411d-8089-679cb2c46e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.048294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d424fb-2ec3-411d-8089-679cb2c46e8c None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.049150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d424fb-2ec3-411d-8089-679cb2c46e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:07.049620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d424fb-2ec3-411d-8089-679cb2c46e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:07.051222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d424fb-2ec3-411d-8089-679cb2c46e8c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:07.069331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 324/650] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:07.070442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d424fb-2ec3-411d-8089-679cb2c46e8c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:07.096237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8b0e2-a198-492d-a7e9-603acf9f41a5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:07.142780 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1dc42-1cfe-433d-81ab-8702539c2c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:07.143612 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1dc42-1cfe-433d-81ab-8702539c2c83 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.143896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1dc42-1cfe-433d-81ab-8702539c2c83 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.144171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1dc42-1cfe-433d-81ab-8702539c2c83 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.152735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1dc42-1cfe-433d-81ab-8702539c2c83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:07.154764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1dc42-1cfe-433d-81ab-8702539c2c83 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-cfa1dc42-1cfe-433d-81ab-8702539c2c83 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:07.174318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:07.176040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:07.176985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:07.176985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:07.176985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:07.176985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:07.176985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:07.176985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:07.176985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:07.176985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:07.176985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 12 14:18:07.176985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:07.179340 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 327/651] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:18:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:07.180295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1dc42-1cfe-433d-81ab-8702539c2c83 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:07.194176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d424fb-2ec3-411d-8089-679cb2c46e8c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:07.227895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e790b-ca17-4740-a670-e7346bbe41dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:07.228608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e790b-ca17-4740-a670-e7346bbe41dc None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.228888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e790b-ca17-4740-a670-e7346bbe41dc None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.229161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e790b-ca17-4740-a670-e7346bbe41dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.239268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e790b-ca17-4740-a670-e7346bbe41dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:07.240715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0e790b-ca17-4740-a670-e7346bbe41dc None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-fb0e790b-ca17-4740-a670-e7346bbe41dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:07.258252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:07.259345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:07.260452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:07.260452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:07.260452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:07.260452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:07.263526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 325/652] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:07.264809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e288f-dcff-475f-8c46-a6e9c5858107 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.265092 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e288f-dcff-475f-8c46-a6e9c5858107 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.265368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e288f-dcff-475f-8c46-a6e9c5858107 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.266648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 326/653] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:07.267359 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e288f-dcff-475f-8c46-a6e9c5858107 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:07.290631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1dc42-1cfe-433d-81ab-8702539c2c83 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:07.323055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22effb9-e2df-4b3d-9cf5-2badced059e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:07.324161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22effb9-e2df-4b3d-9cf5-2badced059e6 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.324641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22effb9-e2df-4b3d-9cf5-2badced059e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.324917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22effb9-e2df-4b3d-9cf5-2badced059e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.332845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22effb9-e2df-4b3d-9cf5-2badced059e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:07.334291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22effb9-e2df-4b3d-9cf5-2badced059e6 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-f22effb9-e2df-4b3d-9cf5-2badced059e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:07.349004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:07.350014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 328/654] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:18:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:07.350957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22effb9-e2df-4b3d-9cf5-2badced059e6 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:07.379372 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e288f-dcff-475f-8c46-a6e9c5858107 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:07.423107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa94dc-f367-4426-8238-90ab34a62670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:07.423845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa94dc-f367-4426-8238-90ab34a62670 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.424177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa94dc-f367-4426-8238-90ab34a62670 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.424455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa94dc-f367-4426-8238-90ab34a62670 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.425306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa94dc-f367-4426-8238-90ab34a62670 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:07.425620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa94dc-f367-4426-8238-90ab34a62670 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:07.427173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa94dc-f367-4426-8238-90ab34a62670 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:07.446310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 327/655] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 12 14:18:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:07.448058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b9a3-a65f-48f3-87d3-6f983ba12a2a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.448556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b9a3-a65f-48f3-87d3-6f983ba12a2a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.449062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8b9a3-a65f-48f3-87d3-6f983ba12a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.466963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-15b8b9a3-a65f-48f3-87d3-6f983ba12a2a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:07.468953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-15b8b9a3-a65f-48f3-87d3-6f983ba12a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:07.471112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22effb9-e2df-4b3d-9cf5-2badced059e6 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:07.506546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80137e19-a261-4901-85fd-9d7a8c486eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:07.507170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80137e19-a261-4901-85fd-9d7a8c486eec None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.507457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80137e19-a261-4901-85fd-9d7a8c486eec None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.507731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80137e19-a261-4901-85fd-9d7a8c486eec None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.508464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80137e19-a261-4901-85fd-9d7a8c486eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:07.508769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80137e19-a261-4901-85fd-9d7a8c486eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:07.510154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80137e19-a261-4901-85fd-9d7a8c486eec None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:07.527667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 329/656] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:07.528680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80137e19-a261-4901-85fd-9d7a8c486eec None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:07.541812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 328/657] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:07.543000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b9a3-a65f-48f3-87d3-6f983ba12a2a None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:07.651017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80137e19-a261-4901-85fd-9d7a8c486eec None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:07.672367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8b9a3-a65f-48f3-87d3-6f983ba12a2a None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:07.685761 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6739e7-4df5-4f94-be27-889e534919f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:07.686438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6739e7-4df5-4f94-be27-889e534919f8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.686718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6739e7-4df5-4f94-be27-889e534919f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.686991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6739e7-4df5-4f94-be27-889e534919f8 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.687860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6739e7-4df5-4f94-be27-889e534919f8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:07.688167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6739e7-4df5-4f94-be27-889e534919f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:07.689595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6739e7-4df5-4f94-be27-889e534919f8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:07.714538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 330/658] 10.222.0.75 () {56 vars in 1137 bytes} [Thu May 12 14:18:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:07.714538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6739e7-4df5-4f94-be27-889e534919f8 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:07.724869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2a146-0e4e-4ee2-8bf8-35978c0f5c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:07.725538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2a146-0e4e-4ee2-8bf8-35978c0f5c67 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.725824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2a146-0e4e-4ee2-8bf8-35978c0f5c67 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.726105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2a146-0e4e-4ee2-8bf8-35978c0f5c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.811594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2a146-0e4e-4ee2-8bf8-35978c0f5c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:07.814041 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2a146-0e4e-4ee2-8bf8-35978c0f5c67 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:07.844398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6739e7-4df5-4f94-be27-889e534919f8 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:07.907056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef0d4f-946e-4b18-98af-5424abbcbb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:07.907056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef0d4f-946e-4b18-98af-5424abbcbb56 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:07.907056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef0d4f-946e-4b18-98af-5424abbcbb56 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:07.907056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef0d4f-946e-4b18-98af-5424abbcbb56 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:07.915014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef0d4f-946e-4b18-98af-5424abbcbb56 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:07.916478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef0d4f-946e-4b18-98af-5424abbcbb56 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-a1ef0d4f-946e-4b18-98af-5424abbcbb56 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:07.932253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:07.933294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:07.935132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 331/659] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:07.935882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef0d4f-946e-4b18-98af-5424abbcbb56 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:07.959686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 329/660] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:18:07.960919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2a146-0e4e-4ee2-8bf8-35978c0f5c67 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:08.053722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef0d4f-946e-4b18-98af-5424abbcbb56 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:08.059810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2a146-0e4e-4ee2-8bf8-35978c0f5c67 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:08.088242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d556c-3a51-422f-9a93-b9009cbd9d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:08.089268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d556c-3a51-422f-9a93-b9009cbd9d1f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:08.089651 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d556c-3a51-422f-9a93-b9009cbd9d1f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:08.089953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d556c-3a51-422f-9a93-b9009cbd9d1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:08.093752 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3a940-dad8-4f49-ba60-cc0669946b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:08.094407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3a940-dad8-4f49-ba60-cc0669946b46 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:08.094695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3a940-dad8-4f49-ba60-cc0669946b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:08.094972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3a940-dad8-4f49-ba60-cc0669946b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:08.100870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d556c-3a51-422f-9a93-b9009cbd9d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-fc4d556c-3a51-422f-9a93-b9009cbd9d1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:08.109224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:08.110198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 332/661] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:08.116305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d556c-3a51-422f-9a93-b9009cbd9d1f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:08.175659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3a940-dad8-4f49-ba60-cc0669946b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:08.177184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3a940-dad8-4f49-ba60-cc0669946b46 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:08.223722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d556c-3a51-422f-9a93-b9009cbd9d1f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:08.260342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b088f-6d7f-4b16-9d64-42b2a2f6cc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:08.261023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b088f-6d7f-4b16-9d64-42b2a2f6cc1d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:08.261311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b088f-6d7f-4b16-9d64-42b2a2f6cc1d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:08.261588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b088f-6d7f-4b16-9d64-42b2a2f6cc1d None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:08.262440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b088f-6d7f-4b16-9d64-42b2a2f6cc1d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:08.262817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b088f-6d7f-4b16-9d64-42b2a2f6cc1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:08.264287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b088f-6d7f-4b16-9d64-42b2a2f6cc1d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:08.281528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 330/662] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:18:08.282669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3a940-dad8-4f49-ba60-cc0669946b46 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:08.287249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 333/663] 10.222.0.75 () {56 vars in 1139 bytes} [Thu May 12 14:18:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:08.287249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b088f-6d7f-4b16-9d64-42b2a2f6cc1d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:08.398576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3a940-dad8-4f49-ba60-cc0669946b46 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:08.413425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b088f-6d7f-4b16-9d64-42b2a2f6cc1d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:08.440769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9d6d8-b84f-4111-ab53-cd9a055a69c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:08.441576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9d6d8-b84f-4111-ab53-cd9a055a69c2 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:08.441862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9d6d8-b84f-4111-ab53-cd9a055a69c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:08.442141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9d6d8-b84f-4111-ab53-cd9a055a69c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:08.453621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9d6d8-b84f-4111-ab53-cd9a055a69c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:08.455107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9d6d8-b84f-4111-ab53-cd9a055a69c2 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:08.466602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408965e5-6c34-4e40-9989-4a1c1e4b6bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:08.468109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408965e5-6c34-4e40-9989-4a1c1e4b6bc5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:08.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408965e5-6c34-4e40-9989-4a1c1e4b6bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:08.469600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408965e5-6c34-4e40-9989-4a1c1e4b6bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:08.471201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408965e5-6c34-4e40-9989-4a1c1e4b6bc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:08.472654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408965e5-6c34-4e40-9989-4a1c1e4b6bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-e9a9d6d8-b84f-4111-ab53-cd9a055a69c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:08.473512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:08.482448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:08.483672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:08.483672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:08.483672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:08.483672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:08.483672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 331/664] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:08.484049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408965e5-6c34-4e40-9989-4a1c1e4b6bc5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:08.484132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9d6d8-b84f-4111-ab53-cd9a055a69c2 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:08.487847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 334/665] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:18:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:08.492973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408965e5-6c34-4e40-9989-4a1c1e4b6bc5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:08.587393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9d6d8-b84f-4111-ab53-cd9a055a69c2 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:08.593212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408965e5-6c34-4e40-9989-4a1c1e4b6bc5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:08.621425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc5257-66d2-4850-b01a-c9c8fa38b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:08.622910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5257-66d2-4850-b01a-c9c8fa38b97c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:08.623225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5257-66d2-4850-b01a-c9c8fa38b97c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:08.623504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc5257-66d2-4850-b01a-c9c8fa38b97c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:08.628734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2abc2-b9e4-4d3c-8f0f-bf2eed434e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:08.629584 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2abc2-b9e4-4d3c-8f0f-bf2eed434e10 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:08.630034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2abc2-b9e4-4d3c-8f0f-bf2eed434e10 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:08.630453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2abc2-b9e4-4d3c-8f0f-bf2eed434e10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:08.633914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc5257-66d2-4850-b01a-c9c8fa38b97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:08.635422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc5257-66d2-4850-b01a-c9c8fa38b97c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-84dc5257-66d2-4850-b01a-c9c8fa38b97c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:08.654173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:08.660054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:08.661182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:08.661182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:08.661182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:08.661182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:08.661182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 332/666] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:08.661182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc5257-66d2-4850-b01a-c9c8fa38b97c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:08.712431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2abc2-b9e4-4d3c-8f0f-bf2eed434e10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:08.713892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2abc2-b9e4-4d3c-8f0f-bf2eed434e10 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:08.761668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc5257-66d2-4850-b01a-c9c8fa38b97c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:08.797924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2450d24-57a8-4ff3-80e7-73fb221621bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:08.798868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2450d24-57a8-4ff3-80e7-73fb221621bb None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:08.799326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2450d24-57a8-4ff3-80e7-73fb221621bb None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:08.799768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2450d24-57a8-4ff3-80e7-73fb221621bb None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:08.800650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2450d24-57a8-4ff3-80e7-73fb221621bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:08.800954 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2450d24-57a8-4ff3-80e7-73fb221621bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:08.803328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2450d24-57a8-4ff3-80e7-73fb221621bb None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:08.819474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 335/667] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:18:08.819474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2abc2-b9e4-4d3c-8f0f-bf2eed434e10 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:08.819775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 333/668] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:08.820223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2450d24-57a8-4ff3-80e7-73fb221621bb None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:08.920413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2450d24-57a8-4ff3-80e7-73fb221621bb None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:08.926212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2abc2-b9e4-4d3c-8f0f-bf2eed434e10 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:08.954935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eccfd-3554-4ec0-9e22-78598995f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:08.955648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eccfd-3554-4ec0-9e22-78598995f24e None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:08.955932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eccfd-3554-4ec0-9e22-78598995f24e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:08.956211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4eccfd-3554-4ec0-9e22-78598995f24e None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:08.956950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eccfd-3554-4ec0-9e22-78598995f24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:08.957261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eccfd-3554-4ec0-9e22-78598995f24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:08.958654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4eccfd-3554-4ec0-9e22-78598995f24e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:08.966884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bae89-fb09-4557-883a-327491677946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:08.967275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bae89-fb09-4557-883a-327491677946 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:08.967558 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bae89-fb09-4557-883a-327491677946 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:08.967835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bae89-fb09-4557-883a-327491677946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:08.976051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 334/669] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:08.976051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eccfd-3554-4ec0-9e22-78598995f24e None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:08.980775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bae89-fb09-4557-883a-327491677946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:08.982791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bae89-fb09-4557-883a-327491677946 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-989bae89-fb09-4557-883a-327491677946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:09.001398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:09.002390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:09.003716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:09.003716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:09.003716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:09.003716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:09.007269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 336/670] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:09.007940 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bae89-fb09-4557-883a-327491677946 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.076376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4eccfd-3554-4ec0-9e22-78598995f24e None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.105601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bae89-fb09-4557-883a-327491677946 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.112250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8130f-4981-46ae-80d1-116fbe2b1497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.113065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8130f-4981-46ae-80d1-116fbe2b1497 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.113351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8130f-4981-46ae-80d1-116fbe2b1497 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.113630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8130f-4981-46ae-80d1-116fbe2b1497 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.124579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8130f-4981-46ae-80d1-116fbe2b1497 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.126543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8130f-4981-46ae-80d1-116fbe2b1497 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.143089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5006f43-1e48-4326-95ad-19ab2fe0c02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.143912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5006f43-1e48-4326-95ad-19ab2fe0c02a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.144181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5006f43-1e48-4326-95ad-19ab2fe0c02a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.144454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5006f43-1e48-4326-95ad-19ab2fe0c02a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-7ae8130f-4981-46ae-80d1-116fbe2b1497 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:09.144886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:09.146007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:09.146896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:09.146896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:09.146896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:09.146896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:09.146896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:09.146896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:09.146896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:09.146896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:09.146896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 335/671] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:09.147436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8130f-4981-46ae-80d1-116fbe2b1497 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.167351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5006f43-1e48-4326-95ad-19ab2fe0c02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.167351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5006f43-1e48-4326-95ad-19ab2fe0c02a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-c5006f43-1e48-4326-95ad-19ab2fe0c02a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:09.187735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:09.188740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:09.189709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:09.189709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:09.189709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:09.189709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:09.193392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 337/672] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:09.194331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5006f43-1e48-4326-95ad-19ab2fe0c02a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.264463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8130f-4981-46ae-80d1-116fbe2b1497 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.300955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728111d-bd10-42d6-a6e3-543c49d7597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.302114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5006f43-1e48-4326-95ad-19ab2fe0c02a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.302403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728111d-bd10-42d6-a6e3-543c49d7597e None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.302888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728111d-bd10-42d6-a6e3-543c49d7597e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.303401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728111d-bd10-42d6-a6e3-543c49d7597e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.311274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728111d-bd10-42d6-a6e3-543c49d7597e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.312822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728111d-bd10-42d6-a6e3-543c49d7597e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-f728111d-bd10-42d6-a6e3-543c49d7597e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:09.327346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:09.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:09.329262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:09.329262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:09.329262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:09.329262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:09.329262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:09.329262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:09.329262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:09.329262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:09.329262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 336/673] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:09.329750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728111d-bd10-42d6-a6e3-543c49d7597e None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.338191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6f9c3-4ba5-46f8-ad86-ff2f9970251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.338867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6f9c3-4ba5-46f8-ad86-ff2f9970251f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.339182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6f9c3-4ba5-46f8-ad86-ff2f9970251f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.339460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6f9c3-4ba5-46f8-ad86-ff2f9970251f None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.340191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6f9c3-4ba5-46f8-ad86-ff2f9970251f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:09.340497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6f9c3-4ba5-46f8-ad86-ff2f9970251f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.341968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6f9c3-4ba5-46f8-ad86-ff2f9970251f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.359516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 338/674] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:09.359516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6f9c3-4ba5-46f8-ad86-ff2f9970251f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.434980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728111d-bd10-42d6-a6e3-543c49d7597e None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.450891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6f9c3-4ba5-46f8-ad86-ff2f9970251f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.467717 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b07346-3da2-4b19-a938-ae6340c7d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.468377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07346-3da2-4b19-a938-ae6340c7d379 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.468664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07346-3da2-4b19-a938-ae6340c7d379 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.468941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b07346-3da2-4b19-a938-ae6340c7d379 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.469738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b07346-3da2-4b19-a938-ae6340c7d379 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:09.470051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b07346-3da2-4b19-a938-ae6340c7d379 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.471528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b07346-3da2-4b19-a938-ae6340c7d379 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.483455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db013ea-80d9-41fb-b5ba-f09efc5bc9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.483975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 337/675] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:09.484131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db013ea-80d9-41fb-b5ba-f09efc5bc9bb None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.484398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db013ea-80d9-41fb-b5ba-f09efc5bc9bb None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.484672 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db013ea-80d9-41fb-b5ba-f09efc5bc9bb None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.484974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782e5a-3451-42d5-aac8-a223def60439 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.485269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782e5a-3451-42d5-aac8-a223def60439 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.485390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db013ea-80d9-41fb-b5ba-f09efc5bc9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:09.485550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782e5a-3451-42d5-aac8-a223def60439 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.485696 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db013ea-80d9-41fb-b5ba-f09efc5bc9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.489872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 338/676] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:09.490021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db013ea-80d9-41fb-b5ba-f09efc5bc9bb None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.490101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57782e5a-3451-42d5-aac8-a223def60439 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.499145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 339/677] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:09.500238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db013ea-80d9-41fb-b5ba-f09efc5bc9bb None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.591480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57782e5a-3451-42d5-aac8-a223def60439 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.595385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db013ea-80d9-41fb-b5ba-f09efc5bc9bb None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.632919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071bc24-1851-4cd3-9576-07425b15aae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.633777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071bc24-1851-4cd3-9576-07425b15aae3 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.634042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071bc24-1851-4cd3-9576-07425b15aae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.634273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071bc24-1851-4cd3-9576-07425b15aae3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.639684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb10954-3a14-4995-b726-234dcb55fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.640359 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb10954-3a14-4995-b726-234dcb55fde1 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.641709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb10954-3a14-4995-b726-234dcb55fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.641709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb10954-3a14-4995-b726-234dcb55fde1 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.641709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb10954-3a14-4995-b726-234dcb55fde1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:09.641993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb10954-3a14-4995-b726-234dcb55fde1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.642449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071bc24-1851-4cd3-9576-07425b15aae3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.643470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb10954-3a14-4995-b726-234dcb55fde1 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.643914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071bc24-1851-4cd3-9576-07425b15aae3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.655832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 339/678] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:09.656658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb10954-3a14-4995-b726-234dcb55fde1 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-8071bc24-1851-4cd3-9576-07425b15aae3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:09.658946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:09.660095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:09.661034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 340/679] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:09.661645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a551bb-9070-495d-a29a-136a678438f4 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.661645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a551bb-9070-495d-a29a-136a678438f4 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.661934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a551bb-9070-495d-a29a-136a678438f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.679197 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-62a551bb-9070-495d-a29a-136a678438f4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:09.681512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-62a551bb-9070-495d-a29a-136a678438f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:09.753440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 341/680] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:09.754222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a551bb-9070-495d-a29a-136a678438f4 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.778051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb10954-3a14-4995-b726-234dcb55fde1 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.813751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70580-af10-493e-bfb5-3db63aeef7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.814414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70580-af10-493e-bfb5-3db63aeef7f8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.814700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70580-af10-493e-bfb5-3db63aeef7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.814980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c70580-af10-493e-bfb5-3db63aeef7f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.815851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c70580-af10-493e-bfb5-3db63aeef7f8 None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=10414e35df26406786eaf49c52661cee) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:09.816165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c70580-af10-493e-bfb5-3db63aeef7f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.817644 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c70580-af10-493e-bfb5-3db63aeef7f8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.823716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 340/681] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/role_assignments?user.id=10414e35df26406786eaf49c52661cee&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:09.824519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70580-af10-493e-bfb5-3db63aeef7f8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.880129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a551bb-9070-495d-a29a-136a678438f4 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.918954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2aefe-dadc-4282-b0ab-9fad6cfbac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.919800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2aefe-dadc-4282-b0ab-9fad6cfbac17 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.920469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2aefe-dadc-4282-b0ab-9fad6cfbac17 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.920721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2aefe-dadc-4282-b0ab-9fad6cfbac17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.928363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2aefe-dadc-4282-b0ab-9fad6cfbac17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.930361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2aefe-dadc-4282-b0ab-9fad6cfbac17 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.939695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c70580-af10-493e-bfb5-3db63aeef7f8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-dcd2aefe-dadc-4282-b0ab-9fad6cfbac17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:09.948710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:09.949668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:09.951112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:09.951112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:09.951112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:09.951112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:09.951112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:09.951112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:09.951112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:09.951112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:09.954750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 342/682] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:09.956265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2aefe-dadc-4282-b0ab-9fad6cfbac17 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:09.978237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb2c80-2dea-4b81-a64c-510a1d510864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:09.979338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb2c80-2dea-4b81-a64c-510a1d510864 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:09.979835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb2c80-2dea-4b81-a64c-510a1d510864 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:09.980347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb2c80-2dea-4b81-a64c-510a1d510864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:09.981342 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb2c80-2dea-4b81-a64c-510a1d510864 None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=cbe18e038b414ef0956a4e8a86586b88) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:09.981824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb2c80-2dea-4b81-a64c-510a1d510864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:09.983462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb2c80-2dea-4b81-a64c-510a1d510864 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:09.990447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 341/683] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/role_assignments?user.id=cbe18e038b414ef0956a4e8a86586b88&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:09.991365 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb2c80-2dea-4b81-a64c-510a1d510864 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:10.111422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2aefe-dadc-4282-b0ab-9fad6cfbac17 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:10.148419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb2c80-2dea-4b81-a64c-510a1d510864 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:10.164967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9f8cf-99a1-421b-b100-8c818be72980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:10.166156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9f8cf-99a1-421b-b100-8c818be72980 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:10.166448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9f8cf-99a1-421b-b100-8c818be72980 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:10.166730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9f8cf-99a1-421b-b100-8c818be72980 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:10.168059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9f8cf-99a1-421b-b100-8c818be72980 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:10.168420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9f8cf-99a1-421b-b100-8c818be72980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:10.171261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9f8cf-99a1-421b-b100-8c818be72980 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:10.193744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50926-d596-4b68-8e55-5a1e64d3e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:10.194711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50926-d596-4b68-8e55-5a1e64d3e032 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:10.195134 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50926-d596-4b68-8e55-5a1e64d3e032 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:10.195536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a50926-d596-4b68-8e55-5a1e64d3e032 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:10.198817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 343/684] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:10.199798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9f8cf-99a1-421b-b100-8c818be72980 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:10.217163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a50926-d596-4b68-8e55-5a1e64d3e032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-d7a50926-d596-4b68-8e55-5a1e64d3e032 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:10.225821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:10.226823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:10.227734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:10.229468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 342/685] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:10.234614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50926-d596-4b68-8e55-5a1e64d3e032 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:10.319449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9f8cf-99a1-421b-b100-8c818be72980 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:10.352036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a50926-d596-4b68-8e55-5a1e64d3e032 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:10.355791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f30a9-7c80-4db6-aa7d-0e2fdcc7609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:10.356533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f30a9-7c80-4db6-aa7d-0e2fdcc7609b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:10.357326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f30a9-7c80-4db6-aa7d-0e2fdcc7609b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:10.357600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f30a9-7c80-4db6-aa7d-0e2fdcc7609b None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:10.358406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f30a9-7c80-4db6-aa7d-0e2fdcc7609b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:10.358715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f30a9-7c80-4db6-aa7d-0e2fdcc7609b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:10.360768 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f30a9-7c80-4db6-aa7d-0e2fdcc7609b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:10.373933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 344/686] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:10.374791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f30a9-7c80-4db6-aa7d-0e2fdcc7609b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:10.387312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77108d28-ed94-4565-ae96-a8e06dc5502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:10.388001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77108d28-ed94-4565-ae96-a8e06dc5502c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:10.388288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77108d28-ed94-4565-ae96-a8e06dc5502c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:10.388566 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77108d28-ed94-4565-ae96-a8e06dc5502c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:10.458768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77108d28-ed94-4565-ae96-a8e06dc5502c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:10.460285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77108d28-ed94-4565-ae96-a8e06dc5502c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:10.478200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f30a9-7c80-4db6-aa7d-0e2fdcc7609b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:10.513414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c4ca9-a75a-4561-b70a-fa9ff828309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:10.514079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c4ca9-a75a-4561-b70a-fa9ff828309d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:10.514358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c4ca9-a75a-4561-b70a-fa9ff828309d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:10.514636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c4ca9-a75a-4561-b70a-fa9ff828309d None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:10.515417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c4ca9-a75a-4561-b70a-fa9ff828309d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:10.515720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c4ca9-a75a-4561-b70a-fa9ff828309d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:10.517208 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c4ca9-a75a-4561-b70a-fa9ff828309d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:10.526591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 345/687] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:10.527613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c4ca9-a75a-4561-b70a-fa9ff828309d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:10.562167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 343/688] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:18:10.563046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77108d28-ed94-4565-ae96-a8e06dc5502c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:10.633440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c4ca9-a75a-4561-b70a-fa9ff828309d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:10.664575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77108d28-ed94-4565-ae96-a8e06dc5502c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:10.668416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fa3e8-04e1-4d8b-8ec1-f17a03da3968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:10.669105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fa3e8-04e1-4d8b-8ec1-f17a03da3968 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:10.669384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fa3e8-04e1-4d8b-8ec1-f17a03da3968 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:10.669655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fa3e8-04e1-4d8b-8ec1-f17a03da3968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:10.670497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fa3e8-04e1-4d8b-8ec1-f17a03da3968 None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=5aca248c2e074fc4baff39930e21fe29) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:10.670806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fa3e8-04e1-4d8b-8ec1-f17a03da3968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:10.672280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fa3e8-04e1-4d8b-8ec1-f17a03da3968 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:10.678942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 346/689] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:10 2022] GET /identity/v3/role_assignments?user.id=5aca248c2e074fc4baff39930e21fe29&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:10.679851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fa3e8-04e1-4d8b-8ec1-f17a03da3968 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:10.712528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e7606-2d38-4342-bc87-f1b9d765dd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:10.713350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e7606-2d38-4342-bc87-f1b9d765dd41 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:10.713633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e7606-2d38-4342-bc87-f1b9d765dd41 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:10.713906 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e7606-2d38-4342-bc87-f1b9d765dd41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:10.736440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e7606-2d38-4342-bc87-f1b9d765dd41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:10.737946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e7606-2d38-4342-bc87-f1b9d765dd41 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-ae4e7606-2d38-4342-bc87-f1b9d765dd41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:10.777189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:10.779855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:10.782018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:10.782018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:10.782018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:10.782018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:10.782018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 344/690] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:10.788354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e7606-2d38-4342-bc87-f1b9d765dd41 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:10.791991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fa3e8-04e1-4d8b-8ec1-f17a03da3968 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:10.829146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e071561-70cb-40e7-91b7-884e93a3e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:10.829955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071561-70cb-40e7-91b7-884e93a3e560 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:10.830233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071561-70cb-40e7-91b7-884e93a3e560 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:10.830506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071561-70cb-40e7-91b7-884e93a3e560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:10.857251 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e071561-70cb-40e7-91b7-884e93a3e560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:10.858725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e071561-70cb-40e7-91b7-884e93a3e560 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-3e071561-70cb-40e7-91b7-884e93a3e560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:10.887738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:10.889838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:10.892122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:10.892122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:10.892122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:10.892122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:10.892122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 347/691] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:10.899643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e071561-70cb-40e7-91b7-884e93a3e560 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:10.914586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e7606-2d38-4342-bc87-f1b9d765dd41 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:10.954141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b73f02-1beb-4ce5-a63f-3ac36f72f7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:10.954832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b73f02-1beb-4ce5-a63f-3ac36f72f7aa None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:10.955147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b73f02-1beb-4ce5-a63f-3ac36f72f7aa None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:10.955424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b73f02-1beb-4ce5-a63f-3ac36f72f7aa None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:10.956176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b73f02-1beb-4ce5-a63f-3ac36f72f7aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:10.956490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b73f02-1beb-4ce5-a63f-3ac36f72f7aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:10.957911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b73f02-1beb-4ce5-a63f-3ac36f72f7aa None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:10.972065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 345/692] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:10.977772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b73f02-1beb-4ce5-a63f-3ac36f72f7aa None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:11.102310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e071561-70cb-40e7-91b7-884e93a3e560 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:11.133608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b73f02-1beb-4ce5-a63f-3ac36f72f7aa None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:11.144888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5fe7a-78b8-4032-8a94-8178d50a5393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:11.147071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5fe7a-78b8-4032-8a94-8178d50a5393 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:11.147071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5fe7a-78b8-4032-8a94-8178d50a5393 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:11.147071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5fe7a-78b8-4032-8a94-8178d50a5393 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:11.147373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5fe7a-78b8-4032-8a94-8178d50a5393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:11.147456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5fe7a-78b8-4032-8a94-8178d50a5393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:11.148801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5fe7a-78b8-4032-8a94-8178d50a5393 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:11.166319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 348/693] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:11.167643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5fe7a-78b8-4032-8a94-8178d50a5393 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:11.180451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830b66-6a7b-453d-b1f7-af4b4dc66fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:11.181489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830b66-6a7b-453d-b1f7-af4b4dc66fbb None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:11.181917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830b66-6a7b-453d-b1f7-af4b4dc66fbb None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:11.182356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4830b66-6a7b-453d-b1f7-af4b4dc66fbb None admin] PATH_INFO: `/v3/users/nova` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:11.193055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4830b66-6a7b-453d-b1f7-af4b4dc66fbb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:11.194757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4830b66-6a7b-453d-b1f7-af4b4dc66fbb None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c4830b66-6a7b-453d-b1f7-af4b4dc66fbb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:11.210078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:11.211330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:11.212502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:11.212502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:11.212502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:11.212502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:11.212502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:11.212502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:11.212502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:11.212502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:11.212502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:18:11.212502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:11.214700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 346/694] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 12 14:18:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:11.220406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830b66-6a7b-453d-b1f7-af4b4dc66fbb None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:11.275443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5fe7a-78b8-4032-8a94-8178d50a5393 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:11.333338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba62b7-ecac-4950-8cc4-9aefbb77396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:11.334141 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba62b7-ecac-4950-8cc4-9aefbb77396a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:11.334421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba62b7-ecac-4950-8cc4-9aefbb77396a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:11.334693 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba62b7-ecac-4950-8cc4-9aefbb77396a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:11.348940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4830b66-6a7b-453d-b1f7-af4b4dc66fbb None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:11.351655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba62b7-ecac-4950-8cc4-9aefbb77396a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:11.353119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba62b7-ecac-4950-8cc4-9aefbb77396a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-09ba62b7-ecac-4950-8cc4-9aefbb77396a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:11.379742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:11.381306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:11.382842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:11.382842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:11.382842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:11.382842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:11.382842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:11.382842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:11.382842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:11.382842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:11.384434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 349/695] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:11.392297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039d06-19a6-42e8-b743-cd2b78f06cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:11.393932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039d06-19a6-42e8-b743-cd2b78f06cbc None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:11.394723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039d06-19a6-42e8-b743-cd2b78f06cbc None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:11.395835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039d06-19a6-42e8-b743-cd2b78f06cbc None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:11.397180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba62b7-ecac-4950-8cc4-9aefbb77396a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:11.398215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc039d06-19a6-42e8-b743-cd2b78f06cbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:11.399007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc039d06-19a6-42e8-b743-cd2b78f06cbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:11.401948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc039d06-19a6-42e8-b743-cd2b78f06cbc None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:11.436624 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 347/696] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 12 14:18:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:11.442682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039d06-19a6-42e8-b743-cd2b78f06cbc None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:11.592486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba62b7-ecac-4950-8cc4-9aefbb77396a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:11.636159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ec5a3-e761-49c5-8b4b-60d102803564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:11.637195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec5a3-e761-49c5-8b4b-60d102803564 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:11.638229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec5a3-e761-49c5-8b4b-60d102803564 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:11.638735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ec5a3-e761-49c5-8b4b-60d102803564 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:11.639823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ec5a3-e761-49c5-8b4b-60d102803564 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:11.640338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ec5a3-e761-49c5-8b4b-60d102803564 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:11.642029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ec5a3-e761-49c5-8b4b-60d102803564 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:11.657131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 350/697] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:11.664418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ec5a3-e761-49c5-8b4b-60d102803564 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:11.681286 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039d06-19a6-42e8-b743-cd2b78f06cbc None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:11.759337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457728ba-62d2-4d1d-8180-b4ace46094ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:11.760490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457728ba-62d2-4d1d-8180-b4ace46094ec None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:11.761046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457728ba-62d2-4d1d-8180-b4ace46094ec None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:11.761626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457728ba-62d2-4d1d-8180-b4ace46094ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:11.796998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ec5a3-e761-49c5-8b4b-60d102803564 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:11.846216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2724f7-8a74-43ed-8247-79417e847f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:11.848269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2724f7-8a74-43ed-8247-79417e847f64 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:11.850638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2724f7-8a74-43ed-8247-79417e847f64 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:11.851547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2724f7-8a74-43ed-8247-79417e847f64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:11.855423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2724f7-8a74-43ed-8247-79417e847f64 None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=2893125208864a1ab2c32e50d5da3f83) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:11.857712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2724f7-8a74-43ed-8247-79417e847f64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:11.865243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2724f7-8a74-43ed-8247-79417e847f64 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:11.874800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 351/698] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:11 2022] GET /identity/v3/role_assignments?user.id=2893125208864a1ab2c32e50d5da3f83&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:11.915829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457728ba-62d2-4d1d-8180-b4ace46094ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:11.918103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457728ba-62d2-4d1d-8180-b4ace46094ec None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:12.084801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 348/699] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 12 14:18:12.090402 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2724f7-8a74-43ed-8247-79417e847f64 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:12.234533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2724f7-8a74-43ed-8247-79417e847f64 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:12.268747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b1254-42df-47b9-9161-19708a753ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:12.269550 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1254-42df-47b9-9161-19708a753ab7 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:12.269832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1254-42df-47b9-9161-19708a753ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:12.270107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b1254-42df-47b9-9161-19708a753ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:12.289640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b1254-42df-47b9-9161-19708a753ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:12.291161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b1254-42df-47b9-9161-19708a753ab7 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-576b1254-42df-47b9-9161-19708a753ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:12.311837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:12.312815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:12.313967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:12.313967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:12.313967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:12.313967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:12.313967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 352/700] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:12.318706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457728ba-62d2-4d1d-8180-b4ace46094ec None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:12.445681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457728ba-62d2-4d1d-8180-b4ace46094ec None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:12.489542 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035daea-d333-45de-afaf-a0bda43b2325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:12.490562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035daea-d333-45de-afaf-a0bda43b2325 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:12.491107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035daea-d333-45de-afaf-a0bda43b2325 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:12.491588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035daea-d333-45de-afaf-a0bda43b2325 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:12.492546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035daea-d333-45de-afaf-a0bda43b2325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:12.493066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035daea-d333-45de-afaf-a0bda43b2325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:12.494726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035daea-d333-45de-afaf-a0bda43b2325 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:12.508026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5fe7-f2d6-435e-bd80-ef2d3426b273 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:12.508649 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5fe7-f2d6-435e-bd80-ef2d3426b273 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:12.509126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d5fe7-f2d6-435e-bd80-ef2d3426b273 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:12.510184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 349/701] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:12.511151 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 353/702] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:12.515886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d5fe7-f2d6-435e-bd80-ef2d3426b273 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:12.516285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46af6-785b-4a71-8c25-71c2826b5016 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:12.516575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46af6-785b-4a71-8c25-71c2826b5016 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:12.516851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db46af6-785b-4a71-8c25-71c2826b5016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:12.545660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-7db46af6-785b-4a71-8c25-71c2826b5016 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:12.546848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7db46af6-785b-4a71-8c25-71c2826b5016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:12.631085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 350/703] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:12.676984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db46af6-785b-4a71-8c25-71c2826b5016 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:12.693880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d5fe7-f2d6-435e-bd80-ef2d3426b273 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:12.755708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898e2cf-72fa-4914-b39b-ab32023ae4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:12.757581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e2cf-72fa-4914-b39b-ab32023ae4c2 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:12.758426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e2cf-72fa-4914-b39b-ab32023ae4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:12.759243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e2cf-72fa-4914-b39b-ab32023ae4c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:12.771565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898e2cf-72fa-4914-b39b-ab32023ae4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:12.773419 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2898e2cf-72fa-4914-b39b-ab32023ae4c2 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-2898e2cf-72fa-4914-b39b-ab32023ae4c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:12.791623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:12.792663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:12.793562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:12.793562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:12.793562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:12.793562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:12.793562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:12.793562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:12.793562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:12.793562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:12.796975 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 354/704] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:12.799171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81484726-1655-4bbf-8b2e-fe31c210198c None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:12.799716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81484726-1655-4bbf-8b2e-fe31c210198c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:12.800200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81484726-1655-4bbf-8b2e-fe31c210198c None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:12.806098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 355/705] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:12.807846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f76de2-f73f-4123-91db-e4ab3951afb7 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:12.808424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f76de2-f73f-4123-91db-e4ab3951afb7 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:12.808903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f76de2-f73f-4123-91db-e4ab3951afb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:12.811455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db46af6-785b-4a71-8c25-71c2826b5016 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:12.826969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-75f76de2-f73f-4123-91db-e4ab3951afb7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:12.828564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-75f76de2-f73f-4123-91db-e4ab3951afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:12.863314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f9b32-150c-4875-8081-f9db90dd1b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:12.864503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f9b32-150c-4875-8081-f9db90dd1b32 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:12.864785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f9b32-150c-4875-8081-f9db90dd1b32 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:12.865059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f9b32-150c-4875-8081-f9db90dd1b32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:12.884973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f9b32-150c-4875-8081-f9db90dd1b32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:12.888143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f9b32-150c-4875-8081-f9db90dd1b32 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-967f9b32-150c-4875-8081-f9db90dd1b32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:12.910204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:12.911316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:12.912797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:12.912797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:12.912797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:12.912797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:12.912797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 351/706] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:12.912797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f9b32-150c-4875-8081-f9db90dd1b32 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:12.929913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 356/707] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:12.931699 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f76de2-f73f-4123-91db-e4ab3951afb7 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:13.031765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f9b32-150c-4875-8081-f9db90dd1b32 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:13.051670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f76de2-f73f-4123-91db-e4ab3951afb7 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:13.069670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5003fbf-ba4b-4540-a26c-a57a38b01e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:13.070720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5003fbf-ba4b-4540-a26c-a57a38b01e33 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:13.071251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5003fbf-ba4b-4540-a26c-a57a38b01e33 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:13.071760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5003fbf-ba4b-4540-a26c-a57a38b01e33 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:13.072763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5003fbf-ba4b-4540-a26c-a57a38b01e33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:13.073288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5003fbf-ba4b-4540-a26c-a57a38b01e33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:13.074956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5003fbf-ba4b-4540-a26c-a57a38b01e33 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:13.086475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cad730-f13e-494c-b436-298a126043de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:13.087176 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad730-f13e-494c-b436-298a126043de None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:13.087459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad730-f13e-494c-b436-298a126043de None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:13.087780 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad730-f13e-494c-b436-298a126043de None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:13.088533 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 352/708] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:13.089571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5003fbf-ba4b-4540-a26c-a57a38b01e33 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:13.093958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cad730-f13e-494c-b436-298a126043de None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:13.093958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cad730-f13e-494c-b436-298a126043de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:13.095279 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cad730-f13e-494c-b436-298a126043de None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:13.108636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 357/709] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:13.109608 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cad730-f13e-494c-b436-298a126043de None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:13.196479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5003fbf-ba4b-4540-a26c-a57a38b01e33 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:13.215798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cad730-f13e-494c-b436-298a126043de None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:13.251552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979f314-6e37-4fbe-8636-51486163ff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:13.252030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6ce3b-8683-40fb-b80b-999e8d8a3500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:13.252463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979f314-6e37-4fbe-8636-51486163ff14 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:13.252948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979f314-6e37-4fbe-8636-51486163ff14 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:13.255629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979f314-6e37-4fbe-8636-51486163ff14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:13.255629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979f314-6e37-4fbe-8636-51486163ff14 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=2366609a0a564e7fbcb05b503de78580) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:13.255629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979f314-6e37-4fbe-8636-51486163ff14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:13.256097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979f314-6e37-4fbe-8636-51486163ff14 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:13.256750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6ce3b-8683-40fb-b80b-999e8d8a3500 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:13.257426 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6ce3b-8683-40fb-b80b-999e8d8a3500 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:13.258181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6ce3b-8683-40fb-b80b-999e8d8a3500 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:13.259643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6ce3b-8683-40fb-b80b-999e8d8a3500 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:13.262186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6ce3b-8683-40fb-b80b-999e8d8a3500 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:13.267182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 358/710] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:13 2022] GET /identity/v3/role_assignments?user.id=2366609a0a564e7fbcb05b503de78580&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:13.268206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979f314-6e37-4fbe-8636-51486163ff14 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-59a6ce3b-8683-40fb-b80b-999e8d8a3500 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:13.288321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:13.289948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:18:13.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:13.295501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 353/711] 10.222.0.75 () {56 vars in 1129 bytes} [Thu May 12 14:18:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:13.302314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6ce3b-8683-40fb-b80b-999e8d8a3500 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:13.415595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6ce3b-8683-40fb-b80b-999e8d8a3500 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:13.452749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf35670-769d-4078-b462-0e58fe992b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:13.453442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979f314-6e37-4fbe-8636-51486163ff14 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:13.454020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf35670-769d-4078-b462-0e58fe992b92 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:13.454537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf35670-769d-4078-b462-0e58fe992b92 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:13.455058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf35670-769d-4078-b462-0e58fe992b92 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:13.455985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf35670-769d-4078-b462-0e58fe992b92 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:13.456500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf35670-769d-4078-b462-0e58fe992b92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:13.458118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf35670-769d-4078-b462-0e58fe992b92 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:13.463585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 354/712] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 12 14:18:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:13.471478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf35670-769d-4078-b462-0e58fe992b92 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:13.531512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc8f438-dc13-4718-b82b-83f0b9fdd3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:13.534354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8f438-dc13-4718-b82b-83f0b9fdd3fb None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:13.536400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8f438-dc13-4718-b82b-83f0b9fdd3fb None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:13.537054 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc8f438-dc13-4718-b82b-83f0b9fdd3fb None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:13.538084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8f438-dc13-4718-b82b-83f0b9fdd3fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:13.542258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc8f438-dc13-4718-b82b-83f0b9fdd3fb None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:13.592530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 359/713] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:18:13 2022] POST /identity/v3/users => generated 254 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:13.677220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf35670-769d-4078-b462-0e58fe992b92 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:13.739855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58194331-ae99-466a-955f-16b4d4e4fdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:13.741070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58194331-ae99-466a-955f-16b4d4e4fdb1 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:13.741576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58194331-ae99-466a-955f-16b4d4e4fdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:13.742044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58194331-ae99-466a-955f-16b4d4e4fdb1 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:13.743294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58194331-ae99-466a-955f-16b4d4e4fdb1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:13.743813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58194331-ae99-466a-955f-16b4d4e4fdb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:13.746363 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58194331-ae99-466a-955f-16b4d4e4fdb1 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:13.752612 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c9e31-f0ac-4982-91ef-ade86c20c810 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:13.753556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c9e31-f0ac-4982-91ef-ade86c20c810 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:13.754076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c9e31-f0ac-4982-91ef-ade86c20c810 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:13.756253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 360/714] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:13.759140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 355/715] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 12 14:18:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:13.763230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786d169-db6e-4d0c-977f-8d53c100d828 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:13.763843 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786d169-db6e-4d0c-977f-8d53c100d828 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:13.764352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786d169-db6e-4d0c-977f-8d53c100d828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:13.792485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-0786d169-db6e-4d0c-977f-8d53c100d828 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:13.793709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0786d169-db6e-4d0c-977f-8d53c100d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:13.890016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 361/716] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:18:13.913701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58194331-ae99-466a-955f-16b4d4e4fdb1 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:14.039630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58194331-ae99-466a-955f-16b4d4e4fdb1 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:14.091691 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca3e84-644a-4283-848a-943e7e7301ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:14.092523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3e84-644a-4283-848a-943e7e7301ba None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:14.092805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3e84-644a-4283-848a-943e7e7301ba None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:14.093080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca3e84-644a-4283-848a-943e7e7301ba None admin] PATH_INFO: `/v3/services/network` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:14.093813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca3e84-644a-4283-848a-943e7e7301ba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:14.095332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca3e84-644a-4283-848a-943e7e7301ba None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-53ca3e84-644a-4283-848a-943e7e7301ba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:14.111684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:14.112751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:14.114001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 356/717] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:13 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:14.120145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786d169-db6e-4d0c-977f-8d53c100d828 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:14.239422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786d169-db6e-4d0c-977f-8d53c100d828 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:14.284509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f68f48-7119-40e9-8f68-651dd0466c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:14.285209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f68f48-7119-40e9-8f68-651dd0466c70 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:14.285496 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f68f48-7119-40e9-8f68-651dd0466c70 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:14.285772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f68f48-7119-40e9-8f68-651dd0466c70 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:14.286499 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f68f48-7119-40e9-8f68-651dd0466c70 None admin] RBAC: Adding query filter params (name=network) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:14.286808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f68f48-7119-40e9-8f68-651dd0466c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:14.288235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f68f48-7119-40e9-8f68-651dd0466c70 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:14.293611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 362/718] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:14.304135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca3e84-644a-4283-848a-943e7e7301ba None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:14.429916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca3e84-644a-4283-848a-943e7e7301ba None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:14.478750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b711ff-31fd-4437-8014-58169f493290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:14.479470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b711ff-31fd-4437-8014-58169f493290 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:14.479755 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b711ff-31fd-4437-8014-58169f493290 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:14.480034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b711ff-31fd-4437-8014-58169f493290 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:14.480760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b711ff-31fd-4437-8014-58169f493290 None admin] RBAC: Adding query filter params (type=network) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:14.481070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b711ff-31fd-4437-8014-58169f493290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:14.483181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b711ff-31fd-4437-8014-58169f493290 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:14.488680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 357/719] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:14.918800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802f36-de0d-4c80-949f-05f03d8fdf10 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:14.919544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802f36-de0d-4c80-949f-05f03d8fdf10 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:14.919544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802f36-de0d-4c80-949f-05f03d8fdf10 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:14.921111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 363/720] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:14.926395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae7052-4157-478b-b9e5-e403504d5162 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:14.926695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae7052-4157-478b-b9e5-e403504d5162 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:14.926979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae7052-4157-478b-b9e5-e403504d5162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:14.952085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f7ae7052-4157-478b-b9e5-e403504d5162 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:14.953327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f7ae7052-4157-478b-b9e5-e403504d5162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:15.056851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 358/721] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:15.092739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802f36-de0d-4c80-949f-05f03d8fdf10 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:15.241668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802f36-de0d-4c80-949f-05f03d8fdf10 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:15.282611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb7f0f-f57d-48b1-ac6c-1f64bfccf909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:15.283522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7f0f-f57d-48b1-ac6c-1f64bfccf909 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:15.283807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7f0f-f57d-48b1-ac6c-1f64bfccf909 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:15.284085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb7f0f-f57d-48b1-ac6c-1f64bfccf909 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:15.309570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb7f0f-f57d-48b1-ac6c-1f64bfccf909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-95fb7f0f-f57d-48b1-ac6c-1f64bfccf909 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:15.319864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:15.322129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:15.324261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:15.331374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 364/722] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:15.336223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae7052-4157-478b-b9e5-e403504d5162 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:15.446120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae7052-4157-478b-b9e5-e403504d5162 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:15.485094 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdba50-0885-4163-b55e-46c682dcb354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:15.486166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdba50-0885-4163-b55e-46c682dcb354 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:15.486657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdba50-0885-4163-b55e-46c682dcb354 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:15.487167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fdba50-0885-4163-b55e-46c682dcb354 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:15.488162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdba50-0885-4163-b55e-46c682dcb354 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:15.488693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdba50-0885-4163-b55e-46c682dcb354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:15.490362 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fdba50-0885-4163-b55e-46c682dcb354 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:15.501244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 359/723] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:18:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:15.506460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb7f0f-f57d-48b1-ac6c-1f64bfccf909 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:15.747266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb7f0f-f57d-48b1-ac6c-1f64bfccf909 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:15.809953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c549c0-dd46-4556-a22e-ed3457c6659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:15.810711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c549c0-dd46-4556-a22e-ed3457c6659d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:15.810994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c549c0-dd46-4556-a22e-ed3457c6659d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:15.811304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c549c0-dd46-4556-a22e-ed3457c6659d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:15.825968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c549c0-dd46-4556-a22e-ed3457c6659d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:15.827575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c549c0-dd46-4556-a22e-ed3457c6659d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-b6c549c0-dd46-4556-a22e-ed3457c6659d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:15.857258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:15.858237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:15.859217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:15.859217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:15.859217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:15.859217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:15.859217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 365/724] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:15.868126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdba50-0885-4163-b55e-46c682dcb354 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:16.002790 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fdba50-0885-4163-b55e-46c682dcb354 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:16.037343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57090c6-bbab-416d-8bcf-29ce4d2183bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:16.038271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57090c6-bbab-416d-8bcf-29ce4d2183bb None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:16.038732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57090c6-bbab-416d-8bcf-29ce4d2183bb None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:16.039198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57090c6-bbab-416d-8bcf-29ce4d2183bb None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:16.040074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57090c6-bbab-416d-8bcf-29ce4d2183bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:16.040527 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57090c6-bbab-416d-8bcf-29ce4d2183bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:16.042048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57090c6-bbab-416d-8bcf-29ce4d2183bb None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:16.056424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 360/725] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:16.064315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c549c0-dd46-4556-a22e-ed3457c6659d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:16.215066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c549c0-dd46-4556-a22e-ed3457c6659d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:16.260737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5269-7bf5-4dc7-8613-f97b8dc6c7e9 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:16.261742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5269-7bf5-4dc7-8613-f97b8dc6c7e9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:16.262386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5269-7bf5-4dc7-8613-f97b8dc6c7e9 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:16.264827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebee820-2421-483c-88d1-e10bfbf1e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:16.265140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 361/726] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:16.269325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebee820-2421-483c-88d1-e10bfbf1e730 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:16.269325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebee820-2421-483c-88d1-e10bfbf1e730 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:16.269325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebee820-2421-483c-88d1-e10bfbf1e730 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:16.271698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eac43-106c-4b14-9b65-1ece7d50ef44 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:16.272239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eac43-106c-4b14-9b65-1ece7d50ef44 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:16.272722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2eac43-106c-4b14-9b65-1ece7d50ef44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:16.280347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebee820-2421-483c-88d1-e10bfbf1e730 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:16.281137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebee820-2421-483c-88d1-e10bfbf1e730 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:16.291774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-af2eac43-106c-4b14-9b65-1ece7d50ef44 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:16.293324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-af2eac43-106c-4b14-9b65-1ece7d50ef44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-cebee820-2421-483c-88d1-e10bfbf1e730 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:16.302633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:16.304319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:16.305598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:16.305598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:16.305598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:16.305598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:16.305598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:16.305598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:16.305598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:16.305598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:16.305598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:18:16.305598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:16.312751 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 366/727] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:16.318480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebee820-2421-483c-88d1-e10bfbf1e730 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:16.385872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 362/728] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 12 14:18:16.412968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2eac43-106c-4b14-9b65-1ece7d50ef44 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:16.512611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebee820-2421-483c-88d1-e10bfbf1e730 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:16.551766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38913e1e-998c-43f0-a150-4ae10e415517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:16.552925 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38913e1e-998c-43f0-a150-4ae10e415517 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:16.553413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38913e1e-998c-43f0-a150-4ae10e415517 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:16.553888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38913e1e-998c-43f0-a150-4ae10e415517 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:16.554936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38913e1e-998c-43f0-a150-4ae10e415517 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:16.555633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38913e1e-998c-43f0-a150-4ae10e415517 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:16.557455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38913e1e-998c-43f0-a150-4ae10e415517 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:16.579220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 367/729] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 12 14:18:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:16.592211 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38913e1e-998c-43f0-a150-4ae10e415517 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:16.610502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2eac43-106c-4b14-9b65-1ece7d50ef44 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:16.647549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e3dd-dfdc-44da-ba65-a79c34622a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:16.648373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e3dd-dfdc-44da-ba65-a79c34622a78 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:16.648659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e3dd-dfdc-44da-ba65-a79c34622a78 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:16.648942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3e3dd-dfdc-44da-ba65-a79c34622a78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:16.661088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3e3dd-dfdc-44da-ba65-a79c34622a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-04f3e3dd-dfdc-44da-ba65-a79c34622a78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:16.668924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:16.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:16.670728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 363/730] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:16.677543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e3dd-dfdc-44da-ba65-a79c34622a78 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:16.733014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38913e1e-998c-43f0-a150-4ae10e415517 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:16.778598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3b981-656f-4b43-be10-a29cb6baea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:16.779381 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3b981-656f-4b43-be10-a29cb6baea81 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:16.779662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3b981-656f-4b43-be10-a29cb6baea81 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:16.779936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3b981-656f-4b43-be10-a29cb6baea81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:16.801018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3e3dd-dfdc-44da-ba65-a79c34622a78 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:16.835720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917ef6-67a7-4d06-9620-f821c9739e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:16.836371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917ef6-67a7-4d06-9620-f821c9739e25 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:16.836655 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917ef6-67a7-4d06-9620-f821c9739e25 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:16.836932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01917ef6-67a7-4d06-9620-f821c9739e25 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:16.837736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917ef6-67a7-4d06-9620-f821c9739e25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:16.838050 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917ef6-67a7-4d06-9620-f821c9739e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:16.839468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01917ef6-67a7-4d06-9620-f821c9739e25 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:16.848381 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3b981-656f-4b43-be10-a29cb6baea81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:16.848665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 364/731] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:16.849904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3b981-656f-4b43-be10-a29cb6baea81 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:16.854137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917ef6-67a7-4d06-9620-f821c9739e25 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:16.964705 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 368/732] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 12 14:18:16.966781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcb69f-7c1a-4b03-847d-56bff18a98b4 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:16.967102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcb69f-7c1a-4b03-847d-56bff18a98b4 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:16.967461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dcb69f-7c1a-4b03-847d-56bff18a98b4 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:16.968715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 369/733] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:16.970094 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d52cb-c32b-4b41-934a-914ae7acc811 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:16.970544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d52cb-c32b-4b41-934a-914ae7acc811 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:16.970728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d52cb-c32b-4b41-934a-914ae7acc811 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:16.972322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 370/734] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:16.972695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01917ef6-67a7-4d06-9620-f821c9739e25 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:16.973067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d52cb-c32b-4b41-934a-914ae7acc811 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:17.018612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf35059-58f7-482e-ae0e-61a27f88bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:17.019453 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35059-58f7-482e-ae0e-61a27f88bf58 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.019740 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35059-58f7-482e-ae0e-61a27f88bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.020015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf35059-58f7-482e-ae0e-61a27f88bf58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.032669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf35059-58f7-482e-ae0e-61a27f88bf58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:17.034154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf35059-58f7-482e-ae0e-61a27f88bf58 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-ddf35059-58f7-482e-ae0e-61a27f88bf58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:17.053765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:17.054746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:17.056073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:17.056073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:17.056073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:17.056073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:17.056073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 365/735] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:17.061368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13935c7-8e9f-499e-a131-594127c403de None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.061368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13935c7-8e9f-499e-a131-594127c403de None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.061368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13935c7-8e9f-499e-a131-594127c403de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.085380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a13935c7-8e9f-499e-a131-594127c403de None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:17.087452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a13935c7-8e9f-499e-a131-594127c403de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:17.090319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d52cb-c32b-4b41-934a-914ae7acc811 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:17.127762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd2355-efe8-4ab9-a92c-52775a89c7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:17.128569 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd2355-efe8-4ab9-a92c-52775a89c7fb None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.128857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd2355-efe8-4ab9-a92c-52775a89c7fb None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.129138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd2355-efe8-4ab9-a92c-52775a89c7fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.139563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd2355-efe8-4ab9-a92c-52775a89c7fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:17.141014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd2355-efe8-4ab9-a92c-52775a89c7fb None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-6bdd2355-efe8-4ab9-a92c-52775a89c7fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:17.160021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:17.161003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:17.161891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:17.161891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:17.161891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:17.161891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:17.161891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 371/736] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:17.162606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dda4c-0cb9-4fab-a042-1d775af55fea None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.162713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dda4c-0cb9-4fab-a042-1d775af55fea None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.162988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dda4c-0cb9-4fab-a042-1d775af55fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.187123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 366/737] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:17.187123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13935c7-8e9f-499e-a131-594127c403de None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:17.193317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c65dda4c-0cb9-4fab-a042-1d775af55fea None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:17.194809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c65dda4c-0cb9-4fab-a042-1d775af55fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:17.282673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 372/738] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:17.283846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dda4c-0cb9-4fab-a042-1d775af55fea None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:17.284122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13935c7-8e9f-499e-a131-594127c403de None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:17.335005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7c95-2861-4c2f-bf87-70cbf5417109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:17.335707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7c95-2861-4c2f-bf87-70cbf5417109 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.335992 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7c95-2861-4c2f-bf87-70cbf5417109 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.336292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7c95-2861-4c2f-bf87-70cbf5417109 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.337004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7c95-2861-4c2f-bf87-70cbf5417109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:17.337310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7c95-2861-4c2f-bf87-70cbf5417109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:17.338743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7c95-2861-4c2f-bf87-70cbf5417109 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:17.350637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 367/739] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:17.355233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7c95-2861-4c2f-bf87-70cbf5417109 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:17.395142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dda4c-0cb9-4fab-a042-1d775af55fea None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:17.441505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd30a1c-d40c-4e31-b23f-5bd191595414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:17.442209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd30a1c-d40c-4e31-b23f-5bd191595414 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.442485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd30a1c-d40c-4e31-b23f-5bd191595414 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.442765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd30a1c-d40c-4e31-b23f-5bd191595414 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.443539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd30a1c-d40c-4e31-b23f-5bd191595414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:17.443854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd30a1c-d40c-4e31-b23f-5bd191595414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:17.445286 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd30a1c-d40c-4e31-b23f-5bd191595414 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:17.462025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 373/740] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:17.462025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd30a1c-d40c-4e31-b23f-5bd191595414 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:17.497562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7c95-2861-4c2f-bf87-70cbf5417109 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:17.543221 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029127d-d1d5-4eef-b4f4-aa468e7d8939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:17.544042 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029127d-d1d5-4eef-b4f4-aa468e7d8939 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.544374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029127d-d1d5-4eef-b4f4-aa468e7d8939 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.544658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029127d-d1d5-4eef-b4f4-aa468e7d8939 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.545400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029127d-d1d5-4eef-b4f4-aa468e7d8939 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:17.547046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029127d-d1d5-4eef-b4f4-aa468e7d8939 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:17.563741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 368/741] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:18:17 2022] POST /identity/v3/services => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:17.564578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029127d-d1d5-4eef-b4f4-aa468e7d8939 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:17.593185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd30a1c-d40c-4e31-b23f-5bd191595414 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:17.654584 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3435c-11c1-479e-9ce8-28e9adb42576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:17.655740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3435c-11c1-479e-9ce8-28e9adb42576 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.656025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3435c-11c1-479e-9ce8-28e9adb42576 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.656334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3435c-11c1-479e-9ce8-28e9adb42576 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.668269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3435c-11c1-479e-9ce8-28e9adb42576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-9dc3435c-11c1-479e-9ce8-28e9adb42576 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:17.676941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:17.678034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:17.678899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:17.679840 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029127d-d1d5-4eef-b4f4-aa468e7d8939 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:17.679918 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 374/742] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:17.679918 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3435c-11c1-479e-9ce8-28e9adb42576 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:17.720380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdc6cbe-d02e-437f-8113-e095cec070e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:17.721230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc6cbe-d02e-437f-8113-e095cec070e9 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.721518 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc6cbe-d02e-437f-8113-e095cec070e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.721795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdc6cbe-d02e-437f-8113-e095cec070e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.732521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc6cbe-d02e-437f-8113-e095cec070e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:17.734699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdc6cbe-d02e-437f-8113-e095cec070e9 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-9fdc6cbe-d02e-437f-8113-e095cec070e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:17.753910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:17.754948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:17.755976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 369/743] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 12 14:18:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:17.756627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d437a-95da-4387-b008-a0e016982c4d None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.756694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d437a-95da-4387-b008-a0e016982c4d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.757302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d437a-95da-4387-b008-a0e016982c4d None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.758534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 370/744] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:17.759305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d437a-95da-4387-b008-a0e016982c4d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:17.805060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3435c-11c1-479e-9ce8-28e9adb42576 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:17.842776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cc145-0119-49f7-9012-5f90adb53586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:17.843998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc145-0119-49f7-9012-5f90adb53586 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.844397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc145-0119-49f7-9012-5f90adb53586 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.844861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc145-0119-49f7-9012-5f90adb53586 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.853836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cc145-0119-49f7-9012-5f90adb53586 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:17.854934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4cc145-0119-49f7-9012-5f90adb53586 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-ee4cc145-0119-49f7-9012-5f90adb53586 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:17.869858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:17.870823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:17.872270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:17.872270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:17.872270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:17.872270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:17.872270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:17.872270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:17.872270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:17.872270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:17.875363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 375/745] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:17.876475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cc145-0119-49f7-9012-5f90adb53586 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:17.885812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d437a-95da-4387-b008-a0e016982c4d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:17.920805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbeff7-2522-4d63-8df3-599589aad154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:17.921487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbeff7-2522-4d63-8df3-599589aad154 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.921774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbeff7-2522-4d63-8df3-599589aad154 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.922049 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbeff7-2522-4d63-8df3-599589aad154 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.922802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbeff7-2522-4d63-8df3-599589aad154 None admin] RBAC: Adding query filter params (name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:17.923135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbeff7-2522-4d63-8df3-599589aad154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:17.924521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bbeff7-2522-4d63-8df3-599589aad154 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:17.933895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 371/746] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:18:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:17.938288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1aa4-efa0-4428-8e25-e92ab4e33234 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:17.938288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1aa4-efa0-4428-8e25-e92ab4e33234 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:17.938288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1aa4-efa0-4428-8e25-e92ab4e33234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:17.959299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-67eb1aa4-efa0-4428-8e25-e92ab4e33234 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:17.961526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-67eb1aa4-efa0-4428-8e25-e92ab4e33234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:17.991127 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cc145-0119-49f7-9012-5f90adb53586 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:18.026748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d401b-eb35-4340-8549-36ce412c4168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:18.027460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d401b-eb35-4340-8549-36ce412c4168 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:18.027741 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d401b-eb35-4340-8549-36ce412c4168 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:18.028062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d401b-eb35-4340-8549-36ce412c4168 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:18.029415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d401b-eb35-4340-8549-36ce412c4168 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:18.029728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d401b-eb35-4340-8549-36ce412c4168 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:18.031204 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d401b-eb35-4340-8549-36ce412c4168 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:18.050557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 372/747] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 12 14:18:18.051759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb1aa4-efa0-4428-8e25-e92ab4e33234 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:18.055369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 376/748] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 12 14:18:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:18.061091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d401b-eb35-4340-8549-36ce412c4168 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:18.192380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb1aa4-efa0-4428-8e25-e92ab4e33234 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:18.229487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfcdc4-3283-46c4-be50-a6ddb35c3206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:18.230172 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfcdc4-3283-46c4-be50-a6ddb35c3206 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:18.230503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfcdc4-3283-46c4-be50-a6ddb35c3206 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:18.230784 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfcdc4-3283-46c4-be50-a6ddb35c3206 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:18.232166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfcdc4-3283-46c4-be50-a6ddb35c3206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:18.232475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfcdc4-3283-46c4-be50-a6ddb35c3206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:18.233939 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cfcdc4-3283-46c4-be50-a6ddb35c3206 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:18.251987 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 373/749] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:18.251987 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfcdc4-3283-46c4-be50-a6ddb35c3206 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:18.306557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d401b-eb35-4340-8549-36ce412c4168 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:18.344675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209d599-ea26-4904-b151-1dde7eb4ebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:18.346084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209d599-ea26-4904-b151-1dde7eb4ebad None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:18.346692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209d599-ea26-4904-b151-1dde7eb4ebad None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:18.347491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209d599-ea26-4904-b151-1dde7eb4ebad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:18.350694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfcdc4-3283-46c4-be50-a6ddb35c3206 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:18.360047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209d599-ea26-4904-b151-1dde7eb4ebad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:18.361522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209d599-ea26-4904-b151-1dde7eb4ebad None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:18.386428 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c962ce-d446-4014-b29d-19d2547c96cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:18.388188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c962ce-d446-4014-b29d-19d2547c96cd None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:18.388652 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c962ce-d446-4014-b29d-19d2547c96cd None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:18.389104 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c962ce-d446-4014-b29d-19d2547c96cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-b209d599-ea26-4904-b151-1dde7eb4ebad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:18.390490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:18.391396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:18.392300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:18.392300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:18.392300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:18.392300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:18.392300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 377/750] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:18.393464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209d599-ea26-4904-b151-1dde7eb4ebad None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:18.408626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c962ce-d446-4014-b29d-19d2547c96cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:18.410122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c962ce-d446-4014-b29d-19d2547c96cd None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-18c962ce-d446-4014-b29d-19d2547c96cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:18.429812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:18.430807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:18.431744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:18.431744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:18.431744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:18.431744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:18.431744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 374/751] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:18.432031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c962ce-d446-4014-b29d-19d2547c96cd None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:18.542205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c962ce-d446-4014-b29d-19d2547c96cd None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:18.544810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209d599-ea26-4904-b151-1dde7eb4ebad None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:18.583479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642faa8-9022-41b8-abee-2a1dc625e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:18.584201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642faa8-9022-41b8-abee-2a1dc625e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:18.584632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642faa8-9022-41b8-abee-2a1dc625e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:18.584880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642faa8-9022-41b8-abee-2a1dc625e5a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:18.586081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642faa8-9022-41b8-abee-2a1dc625e5a7 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=2893125208864a1ab2c32e50d5da3f83) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:18.586406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642faa8-9022-41b8-abee-2a1dc625e5a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:18.588250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642faa8-9022-41b8-abee-2a1dc625e5a7 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:18.606249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 375/752] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:18 2022] GET /identity/v3/role_assignments?user.id=2893125208864a1ab2c32e50d5da3f83&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:18.606249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642faa8-9022-41b8-abee-2a1dc625e5a7 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:18.607818 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336734df-973b-48aa-bc92-36599a23654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:18.608762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336734df-973b-48aa-bc92-36599a23654d None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:18.609262 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336734df-973b-48aa-bc92-36599a23654d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:18.609743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336734df-973b-48aa-bc92-36599a23654d None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:18.610583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336734df-973b-48aa-bc92-36599a23654d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:18.612102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336734df-973b-48aa-bc92-36599a23654d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:18.659091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 378/753] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:18:18 2022] POST /identity/v3/services => generated 240 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:18.659091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336734df-973b-48aa-bc92-36599a23654d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:18.796599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642faa8-9022-41b8-abee-2a1dc625e5a7 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:18.861294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6b776-af55-4317-8381-b3eb65a044e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:18.861987 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6b776-af55-4317-8381-b3eb65a044e2 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:18.862229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336734df-973b-48aa-bc92-36599a23654d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:18.862360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6b776-af55-4317-8381-b3eb65a044e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:18.862531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6b776-af55-4317-8381-b3eb65a044e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:18.863310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6b776-af55-4317-8381-b3eb65a044e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:18.863618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6b776-af55-4317-8381-b3eb65a044e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:18.865063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6b776-af55-4317-8381-b3eb65a044e2 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:18.892665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 376/754] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:18.898465 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6b776-af55-4317-8381-b3eb65a044e2 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:18.908010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91de3b6-4804-400d-b0a3-9770b63afb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:18.908692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de3b6-4804-400d-b0a3-9770b63afb4a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:18.908975 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de3b6-4804-400d-b0a3-9770b63afb4a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:18.909250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91de3b6-4804-400d-b0a3-9770b63afb4a None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:18.909991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91de3b6-4804-400d-b0a3-9770b63afb4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:18.910301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91de3b6-4804-400d-b0a3-9770b63afb4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:18.911722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91de3b6-4804-400d-b0a3-9770b63afb4a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:18.927423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 379/755] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:18.934202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91de3b6-4804-400d-b0a3-9770b63afb4a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:19.026536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6b776-af55-4317-8381-b3eb65a044e2 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:19.041416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91de3b6-4804-400d-b0a3-9770b63afb4a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:19.064862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1107e-9d27-44ff-801e-1de12f483b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:19.065612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1107e-9d27-44ff-801e-1de12f483b10 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:19.065897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1107e-9d27-44ff-801e-1de12f483b10 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:19.066171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1107e-9d27-44ff-801e-1de12f483b10 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:19.074008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1107e-9d27-44ff-801e-1de12f483b10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:19.076059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d1107e-9d27-44ff-801e-1de12f483b10 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:19.078611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23896150-477a-4319-bde9-826706599d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:19.079764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23896150-477a-4319-bde9-826706599d15 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:19.080257 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23896150-477a-4319-bde9-826706599d15 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:19.080728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23896150-477a-4319-bde9-826706599d15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:19.088299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23896150-477a-4319-bde9-826706599d15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:19.090032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23896150-477a-4319-bde9-826706599d15 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-40d1107e-9d27-44ff-801e-1de12f483b10 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:19.092646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:19.093588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:19.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:19.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:19.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:19.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:19.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:19.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:19.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:19.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:19.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:19.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:19.095093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 377/756] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 12 14:18:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:19.104104 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1107e-9d27-44ff-801e-1de12f483b10 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-23896150-477a-4319-bde9-826706599d15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:19.113232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:19.114102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:19.114982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:19.114982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:19.114982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:19.114982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:19.114982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:19.114982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:19.114982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:19.114982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:19.117443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 380/757] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:19.123667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23896150-477a-4319-bde9-826706599d15 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:19.224845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23896150-477a-4319-bde9-826706599d15 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:19.248783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1107e-9d27-44ff-801e-1de12f483b10 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:19.286882 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718256f-0f97-43d4-afd1-3ba39cb0a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:19.287604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718256f-0f97-43d4-afd1-3ba39cb0a441 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:19.287888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718256f-0f97-43d4-afd1-3ba39cb0a441 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:19.288169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718256f-0f97-43d4-afd1-3ba39cb0a441 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:19.289032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718256f-0f97-43d4-afd1-3ba39cb0a441 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:19.289345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718256f-0f97-43d4-afd1-3ba39cb0a441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:19.291138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718256f-0f97-43d4-afd1-3ba39cb0a441 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:19.312348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 378/758] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 12 14:18:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:19.318374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718256f-0f97-43d4-afd1-3ba39cb0a441 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:19.324441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289580e-4466-42df-9a12-b82380e6f3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:19.325720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289580e-4466-42df-9a12-b82380e6f3e0 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:19.326003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289580e-4466-42df-9a12-b82380e6f3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:19.326280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289580e-4466-42df-9a12-b82380e6f3e0 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:19.327118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289580e-4466-42df-9a12-b82380e6f3e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:19.327434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289580e-4466-42df-9a12-b82380e6f3e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:19.329039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289580e-4466-42df-9a12-b82380e6f3e0 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:19.369371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 381/759] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:19.375306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289580e-4466-42df-9a12-b82380e6f3e0 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:19.421015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718256f-0f97-43d4-afd1-3ba39cb0a441 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:19.456316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f24a8e-a4c5-4631-a51c-a9e44823cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:19.457027 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f24a8e-a4c5-4631-a51c-a9e44823cbfc None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:19.457494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f24a8e-a4c5-4631-a51c-a9e44823cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:19.457961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f24a8e-a4c5-4631-a51c-a9e44823cbfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:19.610249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f24a8e-a4c5-4631-a51c-a9e44823cbfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:19.611684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f24a8e-a4c5-4631-a51c-a9e44823cbfc None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:19.616374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289580e-4466-42df-9a12-b82380e6f3e0 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:19.703645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d1334-0cc7-43d1-9ab5-4c7e2e9719cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:19.704546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d1334-0cc7-43d1-9ab5-4c7e2e9719cb None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:19.704828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d1334-0cc7-43d1-9ab5-4c7e2e9719cb None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:19.705103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d1334-0cc7-43d1-9ab5-4c7e2e9719cb None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/2366609a0a564e7fbcb05b503de78580/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:19.716623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d1334-0cc7-43d1-9ab5-4c7e2e9719cb None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=2366609a0a564e7fbcb05b503de78580, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:19.718180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d1334-0cc7-43d1-9ab5-4c7e2e9719cb None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:19.739417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 379/760] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:18:19.740943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f24a8e-a4c5-4631-a51c-a9e44823cbfc None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:19.742441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 382/761] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:18:19 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/2366609a0a564e7fbcb05b503de78580/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:18:19.860766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f24a8e-a4c5-4631-a51c-a9e44823cbfc None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:19.910639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b22ef-423c-4c6b-b870-9e9fa1204287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:19.911493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b22ef-423c-4c6b-b870-9e9fa1204287 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:19.911785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b22ef-423c-4c6b-b870-9e9fa1204287 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:19.912063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b22ef-423c-4c6b-b870-9e9fa1204287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:19.926297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b22ef-423c-4c6b-b870-9e9fa1204287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:19.927851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b22ef-423c-4c6b-b870-9e9fa1204287 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-cd6b22ef-423c-4c6b-b870-9e9fa1204287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:19.957105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:19.958060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:19.958945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:19.958945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:19.958945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:19.958945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:19.958945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 380/762] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:19.965172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d1334-0cc7-43d1-9ab5-4c7e2e9719cb None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:20.042791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71576b8-ddc1-4d55-9249-05b328eb9b25 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:20.043139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71576b8-ddc1-4d55-9249-05b328eb9b25 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:20.043378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71576b8-ddc1-4d55-9249-05b328eb9b25 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:20.046718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 381/763] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:20.051756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe71bdb-975a-4efd-8c8f-3af2083ee4fd None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:20.052032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe71bdb-975a-4efd-8c8f-3af2083ee4fd None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:20.052311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe71bdb-975a-4efd-8c8f-3af2083ee4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:20.084255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-cbe71bdb-975a-4efd-8c8f-3af2083ee4fd None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:20.085468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cbe71bdb-975a-4efd-8c8f-3af2083ee4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:20.117305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d1334-0cc7-43d1-9ab5-4c7e2e9719cb None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:20.152388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0549e1-9f2c-48bc-a4a6-e6253101166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:20.153635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0549e1-9f2c-48bc-a4a6-e6253101166e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:20.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0549e1-9f2c-48bc-a4a6-e6253101166e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:20.154200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0549e1-9f2c-48bc-a4a6-e6253101166e None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:20.154938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0549e1-9f2c-48bc-a4a6-e6253101166e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:20.155276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0549e1-9f2c-48bc-a4a6-e6253101166e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:20.156663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0549e1-9f2c-48bc-a4a6-e6253101166e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:20.158513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 382/764] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:20.177257 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 383/765] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:20.182558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe71bdb-975a-4efd-8c8f-3af2083ee4fd None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:20.194351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0549e1-9f2c-48bc-a4a6-e6253101166e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:20.362066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe71bdb-975a-4efd-8c8f-3af2083ee4fd None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:20.393298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0549e1-9f2c-48bc-a4a6-e6253101166e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:20.399053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6492fae-aa0c-4b00-b458-a40138478819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:20.399053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6492fae-aa0c-4b00-b458-a40138478819 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:20.399053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6492fae-aa0c-4b00-b458-a40138478819 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:20.399053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6492fae-aa0c-4b00-b458-a40138478819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:20.411052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6492fae-aa0c-4b00-b458-a40138478819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:20.411052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6492fae-aa0c-4b00-b458-a40138478819 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-a6492fae-aa0c-4b00-b458-a40138478819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:20.422301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:20.423708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:20.424609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:20.424609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:20.424609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:20.424609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:20.424609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:20.424609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:20.424609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:20.424609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:20.424609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 383/766] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:20.429436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6492fae-aa0c-4b00-b458-a40138478819 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:20.446188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffa48c-9d30-4733-9a7c-66ec8628a451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:20.447507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa48c-9d30-4733-9a7c-66ec8628a451 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:20.447989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa48c-9d30-4733-9a7c-66ec8628a451 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:20.448477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa48c-9d30-4733-9a7c-66ec8628a451 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:20.449353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffa48c-9d30-4733-9a7c-66ec8628a451 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:20.451752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffa48c-9d30-4733-9a7c-66ec8628a451 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-a1ffa48c-9d30-4733-9a7c-66ec8628a451 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:20.466857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:20.468023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:18:20.468872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:20.471941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 384/767] 10.222.0.75 () {56 vars in 1129 bytes} [Thu May 12 14:18:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:20.479179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffa48c-9d30-4733-9a7c-66ec8628a451 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:20.629298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6492fae-aa0c-4b00-b458-a40138478819 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:20.642630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffa48c-9d30-4733-9a7c-66ec8628a451 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:20.690116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f68bd-a5ab-4849-a388-4830a9fbfc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:20.690706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f68bd-a5ab-4849-a388-4830a9fbfc80 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:20.690988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f68bd-a5ab-4849-a388-4830a9fbfc80 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:20.691289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f68bd-a5ab-4849-a388-4830a9fbfc80 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:20.692086 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f68bd-a5ab-4849-a388-4830a9fbfc80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:20.692397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f68bd-a5ab-4849-a388-4830a9fbfc80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:20.693852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f68bd-a5ab-4849-a388-4830a9fbfc80 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:20.701989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d06e4d-51d0-43d3-99c3-1c976b6cc446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:20.702665 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d06e4d-51d0-43d3-99c3-1c976b6cc446 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:20.702952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d06e4d-51d0-43d3-99c3-1c976b6cc446 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:20.703249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d06e4d-51d0-43d3-99c3-1c976b6cc446 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:20.704470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d06e4d-51d0-43d3-99c3-1c976b6cc446 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:20.709306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d06e4d-51d0-43d3-99c3-1c976b6cc446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:20.710709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d06e4d-51d0-43d3-99c3-1c976b6cc446 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:20.720595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 385/768] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 12 14:18:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:20.720905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 384/769] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:20.729814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d06e4d-51d0-43d3-99c3-1c976b6cc446 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:20.736273 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f68bd-a5ab-4849-a388-4830a9fbfc80 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:20.862291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f68bd-a5ab-4849-a388-4830a9fbfc80 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:20.916151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361675c-a304-4bac-810f-29e89727545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:20.917150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361675c-a304-4bac-810f-29e89727545a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:20.917567 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361675c-a304-4bac-810f-29e89727545a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:20.918021 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361675c-a304-4bac-810f-29e89727545a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:20.919941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361675c-a304-4bac-810f-29e89727545a None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=599088a56dbf4c4b9aba49fcbfce8362) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:20.920450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361675c-a304-4bac-810f-29e89727545a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:20.923196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361675c-a304-4bac-810f-29e89727545a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:20.925320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d06e4d-51d0-43d3-99c3-1c976b6cc446 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:20.941983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 385/770] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:20 2022] GET /identity/v3/role_assignments?user.id=599088a56dbf4c4b9aba49fcbfce8362&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:20.964065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0a175-3b50-4379-8fc4-c695cd0a8b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:20.966434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0a175-3b50-4379-8fc4-c695cd0a8b4b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:20.967348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0a175-3b50-4379-8fc4-c695cd0a8b4b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:20.968339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0a175-3b50-4379-8fc4-c695cd0a8b4b None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:20.969412 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0a175-3b50-4379-8fc4-c695cd0a8b4b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:20.969938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0a175-3b50-4379-8fc4-c695cd0a8b4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:20.971636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed0a175-3b50-4379-8fc4-c695cd0a8b4b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:20.979402 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 386/771] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 12 14:18:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:20.988968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361675c-a304-4bac-810f-29e89727545a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:21.123010 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361675c-a304-4bac-810f-29e89727545a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:21.164268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc05e9a-1013-4433-961d-63990fe9a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:21.165003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc05e9a-1013-4433-961d-63990fe9a453 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:21.165291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc05e9a-1013-4433-961d-63990fe9a453 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:21.165568 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc05e9a-1013-4433-961d-63990fe9a453 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:21.166378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc05e9a-1013-4433-961d-63990fe9a453 None admin] RBAC: Adding query filter params (interface=public, service_id=55e0b32ddd4d49d79389bf2ce2941bfa, region_id=RegionOne) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:21.166695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc05e9a-1013-4433-961d-63990fe9a453 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:21.168123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc05e9a-1013-4433-961d-63990fe9a453 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:21.181910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 386/772] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 12 14:18:20 2022] GET /identity/v3/endpoints?service_id=55e0b32ddd4d49d79389bf2ce2941bfa&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:21.183435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0a175-3b50-4379-8fc4-c695cd0a8b4b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:21.311022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee075-46ef-4dea-8db6-0626627c49bb None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:21.311341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee075-46ef-4dea-8db6-0626627c49bb None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:21.311531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee075-46ef-4dea-8db6-0626627c49bb None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:21.313233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 387/773] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:21.321628 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ddf6d-5c27-49aa-931a-781b5da1fcac None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:21.321934 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ddf6d-5c27-49aa-931a-781b5da1fcac None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:21.322191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ddf6d-5c27-49aa-931a-781b5da1fcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:21.336940 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0a175-3b50-4379-8fc4-c695cd0a8b4b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:21.343908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a48ddf6d-5c27-49aa-931a-781b5da1fcac None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:21.345128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a48ddf6d-5c27-49aa-931a-781b5da1fcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:21.381783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bd131-50fb-4b85-8f34-e14b00c8a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:21.382463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bd131-50fb-4b85-8f34-e14b00c8a9ae None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:21.382741 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bd131-50fb-4b85-8f34-e14b00c8a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:21.383012 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bd131-50fb-4b85-8f34-e14b00c8a9ae None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:21.383742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bd131-50fb-4b85-8f34-e14b00c8a9ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:21.385107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bd131-50fb-4b85-8f34-e14b00c8a9ae None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:21.391041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 387/774] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 12 14:18:21 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:21.449277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 388/775] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:21.484357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bd131-50fb-4b85-8f34-e14b00c8a9ae None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:21.612729 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bd131-50fb-4b85-8f34-e14b00c8a9ae None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:21.651772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65c114-6fa4-4684-9bba-444a909f0df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:21.652598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65c114-6fa4-4684-9bba-444a909f0df2 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:21.653406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65c114-6fa4-4684-9bba-444a909f0df2 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:21.653682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65c114-6fa4-4684-9bba-444a909f0df2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:21.669158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65c114-6fa4-4684-9bba-444a909f0df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-de65c114-6fa4-4684-9bba-444a909f0df2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:21.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:21.679274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:21.682965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 388/776] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:21.691284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ddf6d-5c27-49aa-931a-781b5da1fcac None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:21.793122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ddf6d-5c27-49aa-931a-781b5da1fcac None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:21.834583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e324e-b0db-491a-8576-d427cb6f5502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:21.835301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e324e-b0db-491a-8576-d427cb6f5502 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:21.835579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e324e-b0db-491a-8576-d427cb6f5502 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:21.835852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e324e-b0db-491a-8576-d427cb6f5502 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:21.836617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e324e-b0db-491a-8576-d427cb6f5502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:21.836921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e324e-b0db-491a-8576-d427cb6f5502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:21.838311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e324e-b0db-491a-8576-d427cb6f5502 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:21.850237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 389/777] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:18:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:21.856887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65c114-6fa4-4684-9bba-444a909f0df2 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:21.895328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45975-e898-4d4a-8411-aa551239d1cc None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:21.897315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45975-e898-4d4a-8411-aa551239d1cc None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:21.897600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45975-e898-4d4a-8411-aa551239d1cc None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:21.899450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 390/778] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:21.906783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b90fa9-099e-4690-9d23-01bae474d3be None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:21.906783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b90fa9-099e-4690-9d23-01bae474d3be None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:21.906783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b90fa9-099e-4690-9d23-01bae474d3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:21.940695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-36b90fa9-099e-4690-9d23-01bae474d3be None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:21.940695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-36b90fa9-099e-4690-9d23-01bae474d3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:22.056864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65c114-6fa4-4684-9bba-444a909f0df2 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:22.080490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 391/779] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:22.115899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ea6d5-e1a9-419e-8af7-f01c613c656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:22.116709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ea6d5-e1a9-419e-8af7-f01c613c656f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:22.117055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ea6d5-e1a9-419e-8af7-f01c613c656f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:22.117393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ea6d5-e1a9-419e-8af7-f01c613c656f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:22.133038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ea6d5-e1a9-419e-8af7-f01c613c656f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:22.134514 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ea6d5-e1a9-419e-8af7-f01c613c656f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:22.147089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b90fa9-099e-4690-9d23-01bae474d3be None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-233ea6d5-e1a9-419e-8af7-f01c613c656f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:22.162579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:22.163684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:22.164631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:22.164631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:22.164631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:22.164631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:22.164631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 389/780] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:22.171982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ea6d5-e1a9-419e-8af7-f01c613c656f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:22.299812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b90fa9-099e-4690-9d23-01bae474d3be None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:22.372516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ea6d5-e1a9-419e-8af7-f01c613c656f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:22.382948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8138e19-f2c3-4791-a0e5-3d9ce407cba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:22.384125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8138e19-f2c3-4791-a0e5-3d9ce407cba0 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:22.384617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8138e19-f2c3-4791-a0e5-3d9ce407cba0 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:22.385093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8138e19-f2c3-4791-a0e5-3d9ce407cba0 None admin] PATH_INFO: `/v3/services/network` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:22.385983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8138e19-f2c3-4791-a0e5-3d9ce407cba0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:22.387764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8138e19-f2c3-4791-a0e5-3d9ce407cba0 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c8138e19-f2c3-4791-a0e5-3d9ce407cba0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:22.406033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:22.407106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:18:22.407956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:22.412762 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 392/781] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:22 2022] GET /identity/v3/services/network => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:22.418228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8138e19-f2c3-4791-a0e5-3d9ce407cba0 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:22.442021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ba307-d808-47d8-84c1-08cce1b9d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:22.443098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba307-d808-47d8-84c1-08cce1b9d543 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:22.443594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba307-d808-47d8-84c1-08cce1b9d543 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:22.444095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ba307-d808-47d8-84c1-08cce1b9d543 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:22.445031 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ba307-d808-47d8-84c1-08cce1b9d543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:22.445532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ba307-d808-47d8-84c1-08cce1b9d543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:22.447125 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ba307-d808-47d8-84c1-08cce1b9d543 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:22.468418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 390/782] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:22.475327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ba307-d808-47d8-84c1-08cce1b9d543 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:22.535654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8138e19-f2c3-4791-a0e5-3d9ce407cba0 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:22.569259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f9eea-56df-4490-9c02-d6a54c01fa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:22.569930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f9eea-56df-4490-9c02-d6a54c01fa8a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:22.570213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f9eea-56df-4490-9c02-d6a54c01fa8a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:22.570490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f9eea-56df-4490-9c02-d6a54c01fa8a None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:22.571229 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f9eea-56df-4490-9c02-d6a54c01fa8a None admin] RBAC: Adding query filter params (name=network) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:22.571536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f9eea-56df-4490-9c02-d6a54c01fa8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:22.572980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f9eea-56df-4490-9c02-d6a54c01fa8a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:22.578472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 393/783] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:22.584265 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a09b6-acce-4992-b9dc-04792d9d2a1b None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:22.584565 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a09b6-acce-4992-b9dc-04792d9d2a1b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:22.584846 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a09b6-acce-4992-b9dc-04792d9d2a1b None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:22.586440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 394/784] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:22.587203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a09b6-acce-4992-b9dc-04792d9d2a1b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:22.612866 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ba307-d808-47d8-84c1-08cce1b9d543 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:22.647624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c89841-a001-43f9-ad4c-09fa3d7eb37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:22.648421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c89841-a001-43f9-ad4c-09fa3d7eb37c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:22.648698 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c89841-a001-43f9-ad4c-09fa3d7eb37c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:22.648970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c89841-a001-43f9-ad4c-09fa3d7eb37c None admin] PATH_INFO: `/v3/users/swift` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:22.656194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c89841-a001-43f9-ad4c-09fa3d7eb37c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:22.657564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c89841-a001-43f9-ad4c-09fa3d7eb37c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-21c89841-a001-43f9-ad4c-09fa3d7eb37c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:22.672321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:22.673302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:22.674273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 391/785] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:22.675733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dffd68-0822-4315-bab9-06c5e9dcf795 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:22.675733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dffd68-0822-4315-bab9-06c5e9dcf795 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:22.675733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dffd68-0822-4315-bab9-06c5e9dcf795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:22.693806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-f5dffd68-0822-4315-bab9-06c5e9dcf795 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:22.694981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f5dffd68-0822-4315-bab9-06c5e9dcf795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:22.696686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a09b6-acce-4992-b9dc-04792d9d2a1b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:22.729475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163db3-93b6-4b11-b55d-de5597aca0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:22.730149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163db3-93b6-4b11-b55d-de5597aca0c5 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:22.730430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163db3-93b6-4b11-b55d-de5597aca0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:22.730708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13163db3-93b6-4b11-b55d-de5597aca0c5 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:22.732006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13163db3-93b6-4b11-b55d-de5597aca0c5 None admin] RBAC: Adding query filter params (type=network) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:22.732317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13163db3-93b6-4b11-b55d-de5597aca0c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:22.733692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13163db3-93b6-4b11-b55d-de5597aca0c5 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:22.743482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 395/786] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:22.744407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163db3-93b6-4b11-b55d-de5597aca0c5 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:22.771181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 392/787] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:22.772205 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dffd68-0822-4315-bab9-06c5e9dcf795 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:22.851852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13163db3-93b6-4b11-b55d-de5597aca0c5 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:22.897634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59a024-4afd-48ba-9842-1f6337798a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:22.898394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59a024-4afd-48ba-9842-1f6337798a1b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:22.898684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59a024-4afd-48ba-9842-1f6337798a1b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:22.899117 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59a024-4afd-48ba-9842-1f6337798a1b None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:22.900045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59a024-4afd-48ba-9842-1f6337798a1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:22.900365 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59a024-4afd-48ba-9842-1f6337798a1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:22.901869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59a024-4afd-48ba-9842-1f6337798a1b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:22.903954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dffd68-0822-4315-bab9-06c5e9dcf795 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:22.926395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 396/788] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 12 14:18:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:22.931522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59a024-4afd-48ba-9842-1f6337798a1b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:22.942604 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03fcba-8df9-4c44-8093-b7c1034c2a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:22.943302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03fcba-8df9-4c44-8093-b7c1034c2a2e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:22.943583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03fcba-8df9-4c44-8093-b7c1034c2a2e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:22.943857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03fcba-8df9-4c44-8093-b7c1034c2a2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:22.944652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03fcba-8df9-4c44-8093-b7c1034c2a2e None admin] RBAC: Adding query filter params (interface=public, service_id=b7e43330354f4727b1269503a0b89cab, region_id=RegionOne) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:22.944963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03fcba-8df9-4c44-8093-b7c1034c2a2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:22.946333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03fcba-8df9-4c44-8093-b7c1034c2a2e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:22.958133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 393/789] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 12 14:18:22 2022] GET /identity/v3/endpoints?service_id=b7e43330354f4727b1269503a0b89cab&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:22.959010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03fcba-8df9-4c44-8093-b7c1034c2a2e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:23.045526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59a024-4afd-48ba-9842-1f6337798a1b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:23.066047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03fcba-8df9-4c44-8093-b7c1034c2a2e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:23.080511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e251b1-0a63-4c22-aa06-98217383d605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:23.081324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e251b1-0a63-4c22-aa06-98217383d605 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.081609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e251b1-0a63-4c22-aa06-98217383d605 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.081888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e251b1-0a63-4c22-aa06-98217383d605 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.093210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e251b1-0a63-4c22-aa06-98217383d605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c6e251b1-0a63-4c22-aa06-98217383d605 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:23.101323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:23.103545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:23.105405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:23.106791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a619b-938a-4cdd-bf78-d45832ba24c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:23.106791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a619b-938a-4cdd-bf78-d45832ba24c5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.106791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a619b-938a-4cdd-bf78-d45832ba24c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.106791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a619b-938a-4cdd-bf78-d45832ba24c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.107142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 397/790] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:23.107142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e251b1-0a63-4c22-aa06-98217383d605 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:23.120427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a619b-938a-4cdd-bf78-d45832ba24c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:23.121959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a619b-938a-4cdd-bf78-d45832ba24c5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-958a619b-938a-4cdd-bf78-d45832ba24c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:23.140265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:23.142442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:23.144821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:23.144821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:23.144821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:23.144821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:23.144821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 394/791] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:23.144821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a619b-938a-4cdd-bf78-d45832ba24c5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:23.221458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e251b1-0a63-4c22-aa06-98217383d605 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:23.253690 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a619b-938a-4cdd-bf78-d45832ba24c5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:23.258403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193d091-ea0a-4d8e-8c25-25ba0670c318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:23.259108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193d091-ea0a-4d8e-8c25-25ba0670c318 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.259396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193d091-ea0a-4d8e-8c25-25ba0670c318 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.259671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193d091-ea0a-4d8e-8c25-25ba0670c318 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.260361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193d091-ea0a-4d8e-8c25-25ba0670c318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:23.261754 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193d091-ea0a-4d8e-8c25-25ba0670c318 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:23.275360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 398/792] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 12 14:18:23 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:23.276392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193d091-ea0a-4d8e-8c25-25ba0670c318 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:23.290843 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd6ee2-b756-44bc-84e8-e2af22587817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:23.291597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6ee2-b756-44bc-84e8-e2af22587817 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.291895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6ee2-b756-44bc-84e8-e2af22587817 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.292135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd6ee2-b756-44bc-84e8-e2af22587817 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.292993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd6ee2-b756-44bc-84e8-e2af22587817 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:23.293344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd6ee2-b756-44bc-84e8-e2af22587817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:23.295357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd6ee2-b756-44bc-84e8-e2af22587817 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:23.310949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 395/793] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:18:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:23.313036 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd6ee2-b756-44bc-84e8-e2af22587817 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:23.434057 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193d091-ea0a-4d8e-8c25-25ba0670c318 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:23.477249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88b83-c216-47d4-af3e-7286d1576b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:23.478004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88b83-c216-47d4-af3e-7286d1576b4f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.478370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88b83-c216-47d4-af3e-7286d1576b4f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.478654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d88b83-c216-47d4-af3e-7286d1576b4f None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.479505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d88b83-c216-47d4-af3e-7286d1576b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:23.479818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d88b83-c216-47d4-af3e-7286d1576b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:23.481955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d88b83-c216-47d4-af3e-7286d1576b4f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:23.497812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 399/794] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:23.504312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88b83-c216-47d4-af3e-7286d1576b4f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:23.528434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd6ee2-b756-44bc-84e8-e2af22587817 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:23.597201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7311a1b-21bb-4119-9a8c-43f363610f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:23.598012 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7311a1b-21bb-4119-9a8c-43f363610f20 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.598298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7311a1b-21bb-4119-9a8c-43f363610f20 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.598577 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7311a1b-21bb-4119-9a8c-43f363610f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.611963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7311a1b-21bb-4119-9a8c-43f363610f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:23.613879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7311a1b-21bb-4119-9a8c-43f363610f20 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-c7311a1b-21bb-4119-9a8c-43f363610f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:23.636657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:23.638763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:23.640886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:23.640886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:23.640886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:23.640886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:23.640886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 396/795] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:23.649743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7311a1b-21bb-4119-9a8c-43f363610f20 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:23.696662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d88b83-c216-47d4-af3e-7286d1576b4f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:23.740758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d697e15-797e-4dfc-b60e-ef1b36e9df82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:23.741530 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d697e15-797e-4dfc-b60e-ef1b36e9df82 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.741813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d697e15-797e-4dfc-b60e-ef1b36e9df82 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.742089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d697e15-797e-4dfc-b60e-ef1b36e9df82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.750965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d697e15-797e-4dfc-b60e-ef1b36e9df82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:23.752679 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d697e15-797e-4dfc-b60e-ef1b36e9df82 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:23.781631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7311a1b-21bb-4119-9a8c-43f363610f20 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-9d697e15-797e-4dfc-b60e-ef1b36e9df82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:23.782076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:23.784205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:23.786520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:23.786520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:23.786520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:23.786520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:23.786520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:23.786520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:23.786520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:23.786520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:23.792338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 400/796] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:23.796344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107fc3d-0efc-4769-a91a-0c7262cab6f3 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.796675 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107fc3d-0efc-4769-a91a-0c7262cab6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.797424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107fc3d-0efc-4769-a91a-0c7262cab6f3 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.802652 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 401/797] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:23 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:23.803571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107fc3d-0efc-4769-a91a-0c7262cab6f3 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:23.837332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf70ff-a93b-4954-9221-cf3e2f461b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:23.838299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf70ff-a93b-4954-9221-cf3e2f461b49 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.838584 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf70ff-a93b-4954-9221-cf3e2f461b49 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.838863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf70ff-a93b-4954-9221-cf3e2f461b49 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.839646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf70ff-a93b-4954-9221-cf3e2f461b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:23.839955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf70ff-a93b-4954-9221-cf3e2f461b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:23.841655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf70ff-a93b-4954-9221-cf3e2f461b49 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:23.857856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 397/798] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:23.859582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bbad3-121d-488d-95e2-1d99bb96d2eb None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.859874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bbad3-121d-488d-95e2-1d99bb96d2eb None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.860157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bbad3-121d-488d-95e2-1d99bb96d2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.881796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c41bbad3-121d-488d-95e2-1d99bb96d2eb None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:23.883361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c41bbad3-121d-488d-95e2-1d99bb96d2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:23.929244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107fc3d-0efc-4769-a91a-0c7262cab6f3 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:23.977798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 398/799] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:23.978661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bbad3-121d-488d-95e2-1d99bb96d2eb None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:23.982220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840815d-3f02-4a9e-983a-bece2feb9613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:23.984253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840815d-3f02-4a9e-983a-bece2feb9613 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:23.985362 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840815d-3f02-4a9e-983a-bece2feb9613 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:23.986172 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840815d-3f02-4a9e-983a-bece2feb9613 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:23.988012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840815d-3f02-4a9e-983a-bece2feb9613 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:23.988880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840815d-3f02-4a9e-983a-bece2feb9613 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:23.992051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840815d-3f02-4a9e-983a-bece2feb9613 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:24.009963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 402/800] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:24.016994 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840815d-3f02-4a9e-983a-bece2feb9613 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:24.093507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bbad3-121d-488d-95e2-1d99bb96d2eb None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:24.124878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840815d-3f02-4a9e-983a-bece2feb9613 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:24.129869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31456d-b423-4336-883d-374885f320b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:24.130673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31456d-b423-4336-883d-374885f320b3 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:24.130958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31456d-b423-4336-883d-374885f320b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:24.131263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31456d-b423-4336-883d-374885f320b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:24.139627 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31456d-b423-4336-883d-374885f320b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:24.141104 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31456d-b423-4336-883d-374885f320b3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-2e31456d-b423-4336-883d-374885f320b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:24.157642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:24.159066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 399/801] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 12 14:18:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:24.160603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31456d-b423-4336-883d-374885f320b3 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:24.172916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d014f-e8d4-4260-a29f-bbf4e4543afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:24.174768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d014f-e8d4-4260-a29f-bbf4e4543afd None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:24.175486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d014f-e8d4-4260-a29f-bbf4e4543afd None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:24.176167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d014f-e8d4-4260-a29f-bbf4e4543afd None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/2893125208864a1ab2c32e50d5da3f83/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:24.179667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d014f-e8d4-4260-a29f-bbf4e4543afd None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=2893125208864a1ab2c32e50d5da3f83, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:24.182660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d014f-e8d4-4260-a29f-bbf4e4543afd None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:24.213815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 403/802] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:18:24 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/2893125208864a1ab2c32e50d5da3f83/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:18:24.213815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d014f-e8d4-4260-a29f-bbf4e4543afd None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:24.296957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31456d-b423-4336-883d-374885f320b3 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:24.335912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa9b3a-e568-4581-9bdb-c875ddd13442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:24.336724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa9b3a-e568-4581-9bdb-c875ddd13442 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:24.337010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa9b3a-e568-4581-9bdb-c875ddd13442 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:24.337288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa9b3a-e568-4581-9bdb-c875ddd13442 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:24.343831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d014f-e8d4-4260-a29f-bbf4e4543afd None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:24.349533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa9b3a-e568-4581-9bdb-c875ddd13442 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-96aa9b3a-e568-4581-9bdb-c875ddd13442 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:24.359629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:24.360629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:24.361485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 400/803] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:24.367433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf20810-3c09-4629-99a9-a6a8a47e8508 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:24.367722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf20810-3c09-4629-99a9-a6a8a47e8508 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:24.368002 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf20810-3c09-4629-99a9-a6a8a47e8508 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:24.370063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 401/804] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:24.370932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf20810-3c09-4629-99a9-a6a8a47e8508 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:24.386525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a174a5-5137-4ea4-b162-9c42953cdc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:24.387442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a174a5-5137-4ea4-b162-9c42953cdc87 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:24.387654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a174a5-5137-4ea4-b162-9c42953cdc87 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:24.387908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a174a5-5137-4ea4-b162-9c42953cdc87 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:24.388759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a174a5-5137-4ea4-b162-9c42953cdc87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:24.389067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a174a5-5137-4ea4-b162-9c42953cdc87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:24.390608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a174a5-5137-4ea4-b162-9c42953cdc87 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:24.410385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 404/805] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 12 14:18:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:24.412201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189b70-dda9-4dfd-83bf-725babace9e3 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:24.412492 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189b70-dda9-4dfd-83bf-725babace9e3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:24.412765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e189b70-dda9-4dfd-83bf-725babace9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:24.430055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-3e189b70-dda9-4dfd-83bf-725babace9e3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:24.431296 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3e189b70-dda9-4dfd-83bf-725babace9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:24.485287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf20810-3c09-4629-99a9-a6a8a47e8508 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:24.510043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 405/806] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:24.510986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e189b70-dda9-4dfd-83bf-725babace9e3 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:24.540024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55949e4-1b6f-4406-83c2-d7bf40404da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:24.540705 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55949e4-1b6f-4406-83c2-d7bf40404da9 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:24.540982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55949e4-1b6f-4406-83c2-d7bf40404da9 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:24.541256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55949e4-1b6f-4406-83c2-d7bf40404da9 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:24.542116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55949e4-1b6f-4406-83c2-d7bf40404da9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:24.542421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55949e4-1b6f-4406-83c2-d7bf40404da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:24.547471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55949e4-1b6f-4406-83c2-d7bf40404da9 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:24.557342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 402/807] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:18:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:24.558327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55949e4-1b6f-4406-83c2-d7bf40404da9 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:24.645588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e189b70-dda9-4dfd-83bf-725babace9e3 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:24.671865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55949e4-1b6f-4406-83c2-d7bf40404da9 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:24.689670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fb44e-ddf3-4c49-89e6-f38149d07b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:24.690623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fb44e-ddf3-4c49-89e6-f38149d07b72 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:24.690917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fb44e-ddf3-4c49-89e6-f38149d07b72 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:24.691226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fb44e-ddf3-4c49-89e6-f38149d07b72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:24.711212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debd6e2-d55b-43a1-9d9f-9c642955fbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:24.712073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debd6e2-d55b-43a1-9d9f-9c642955fbac None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:24.712357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debd6e2-d55b-43a1-9d9f-9c642955fbac None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:24.712626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debd6e2-d55b-43a1-9d9f-9c642955fbac None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:24.713288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debd6e2-d55b-43a1-9d9f-9c642955fbac None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:24.714943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debd6e2-d55b-43a1-9d9f-9c642955fbac None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-5debd6e2-d55b-43a1-9d9f-9c642955fbac None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:24.728901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:24.731863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 12 14:18:24.733965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:24.735969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 403/808] 10.222.0.75 () {56 vars in 1129 bytes} [Thu May 12 14:18:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:24.739066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debd6e2-d55b-43a1-9d9f-9c642955fbac None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:24.788864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fb44e-ddf3-4c49-89e6-f38149d07b72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:24.790631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73fb44e-ddf3-4c49-89e6-f38149d07b72 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:24.881553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debd6e2-d55b-43a1-9d9f-9c642955fbac None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:24.908050 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 406/809] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:18:24.908935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fb44e-ddf3-4c49-89e6-f38149d07b72 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:24.927820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afc663-72bb-4545-bba4-281dfd1cc101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:24.929023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc663-72bb-4545-bba4-281dfd1cc101 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:24.929541 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc663-72bb-4545-bba4-281dfd1cc101 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:24.930026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc663-72bb-4545-bba4-281dfd1cc101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:24.944739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afc663-72bb-4545-bba4-281dfd1cc101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:24.947382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afc663-72bb-4545-bba4-281dfd1cc101 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-31afc663-72bb-4545-bba4-281dfd1cc101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:24.971508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:24.972474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:24.973362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:24.973362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:24.973362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:24.973362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:24.983346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 404/810] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:24.983346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afc663-72bb-4545-bba4-281dfd1cc101 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:25.049565 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fb44e-ddf3-4c49-89e6-f38149d07b72 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:25.086774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afc663-72bb-4545-bba4-281dfd1cc101 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:25.093786 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b276e12-9e3d-4716-96f5-38ddb0190a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:25.095278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276e12-9e3d-4716-96f5-38ddb0190a13 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:25.095779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276e12-9e3d-4716-96f5-38ddb0190a13 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:25.096656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b276e12-9e3d-4716-96f5-38ddb0190a13 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:25.097895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b276e12-9e3d-4716-96f5-38ddb0190a13 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:25.098711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b276e12-9e3d-4716-96f5-38ddb0190a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:25.100518 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b276e12-9e3d-4716-96f5-38ddb0190a13 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:25.113964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 407/811] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 12 14:18:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:25.113964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b276e12-9e3d-4716-96f5-38ddb0190a13 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:25.132902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d31833-df66-49bb-8fc7-338f784ae91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:25.134098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d31833-df66-49bb-8fc7-338f784ae91f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:25.134588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d31833-df66-49bb-8fc7-338f784ae91f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:25.135557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d31833-df66-49bb-8fc7-338f784ae91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:25.151387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d31833-df66-49bb-8fc7-338f784ae91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:25.153875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d31833-df66-49bb-8fc7-338f784ae91f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-f7d31833-df66-49bb-8fc7-338f784ae91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:25.178130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:25.179106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:25.180001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:25.180001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:25.180001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:25.180001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:25.181808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 405/812] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:25.181808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d31833-df66-49bb-8fc7-338f784ae91f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:25.227250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b276e12-9e3d-4716-96f5-38ddb0190a13 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:25.269976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffdeee-74d2-45a8-bf48-a5e30e402796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:25.271295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffdeee-74d2-45a8-bf48-a5e30e402796 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:25.271746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffdeee-74d2-45a8-bf48-a5e30e402796 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:25.272196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffdeee-74d2-45a8-bf48-a5e30e402796 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:25.273192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffdeee-74d2-45a8-bf48-a5e30e402796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:25.273566 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffdeee-74d2-45a8-bf48-a5e30e402796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:25.275003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffdeee-74d2-45a8-bf48-a5e30e402796 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:25.294546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 408/813] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:25.294546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffdeee-74d2-45a8-bf48-a5e30e402796 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:25.318906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d31833-df66-49bb-8fc7-338f784ae91f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:25.362032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4795a-1e3c-47c1-8e51-0bb17e62b414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:25.362717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4795a-1e3c-47c1-8e51-0bb17e62b414 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:25.362989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4795a-1e3c-47c1-8e51-0bb17e62b414 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:25.363281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4795a-1e3c-47c1-8e51-0bb17e62b414 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:25.364054 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4795a-1e3c-47c1-8e51-0bb17e62b414 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:25.364295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4795a-1e3c-47c1-8e51-0bb17e62b414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:25.365668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4795a-1e3c-47c1-8e51-0bb17e62b414 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:25.375070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 406/814] 10.222.0.75 () {56 vars in 1124 bytes} [Thu May 12 14:18:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:25.375070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4795a-1e3c-47c1-8e51-0bb17e62b414 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:25.412787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffdeee-74d2-45a8-bf48-a5e30e402796 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:25.449979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdf3bb-5844-4357-bb2b-a9bc6fb7e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:25.451008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf3bb-5844-4357-bb2b-a9bc6fb7e4b6 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:25.451417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf3bb-5844-4357-bb2b-a9bc6fb7e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:25.459103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdf3bb-5844-4357-bb2b-a9bc6fb7e4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:25.459103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdf3bb-5844-4357-bb2b-a9bc6fb7e4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:25.459103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdf3bb-5844-4357-bb2b-a9bc6fb7e4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:25.459103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdf3bb-5844-4357-bb2b-a9bc6fb7e4b6 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:25.475481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 409/815] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:25.476654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdf3bb-5844-4357-bb2b-a9bc6fb7e4b6 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:25.486410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4795a-1e3c-47c1-8e51-0bb17e62b414 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:25.523150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fab1ce-be41-4a77-8d49-76e1414a981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:25.523974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fab1ce-be41-4a77-8d49-76e1414a981e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:25.524256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fab1ce-be41-4a77-8d49-76e1414a981e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:25.524532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fab1ce-be41-4a77-8d49-76e1414a981e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:25.534174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fab1ce-be41-4a77-8d49-76e1414a981e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:25.535678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fab1ce-be41-4a77-8d49-76e1414a981e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-57fab1ce-be41-4a77-8d49-76e1414a981e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:25.552162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:25.553335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:25.554411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 407/816] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 12 14:18:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:25.555177 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fab1ce-be41-4a77-8d49-76e1414a981e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:25.611868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdf3bb-5844-4357-bb2b-a9bc6fb7e4b6 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:25.666551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fab1ce-be41-4a77-8d49-76e1414a981e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:25.706066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5f6a9-b9c9-4635-8b17-6c84bfba9173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:25.707021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f6a9-b9c9-4635-8b17-6c84bfba9173 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:25.707400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f6a9-b9c9-4635-8b17-6c84bfba9173 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:25.707745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5f6a9-b9c9-4635-8b17-6c84bfba9173 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:25.723061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5f6a9-b9c9-4635-8b17-6c84bfba9173 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:25.723061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5f6a9-b9c9-4635-8b17-6c84bfba9173 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-fbf5f6a9-b9c9-4635-8b17-6c84bfba9173 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:25.738039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:25.739207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:25.740692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:25.740692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:25.740692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:25.740692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:25.740692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:25.740692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:25.740692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:25.740692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:25.747157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 408/817] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:25.747157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5f6a9-b9c9-4635-8b17-6c84bfba9173 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:25.781088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7126d6-aefe-4788-bf70-727e111969af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:25.781855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7126d6-aefe-4788-bf70-727e111969af None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:25.782210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7126d6-aefe-4788-bf70-727e111969af None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:25.782579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7126d6-aefe-4788-bf70-727e111969af None admin] PATH_INFO: `/v3/endpoints` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:25.783534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7126d6-aefe-4788-bf70-727e111969af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:25.785076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7126d6-aefe-4788-bf70-727e111969af None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:25.814645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 410/818] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 12 14:18:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:25.815919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7126d6-aefe-4788-bf70-727e111969af None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:25.878678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5f6a9-b9c9-4635-8b17-6c84bfba9173 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:25.945003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45491dfb-e732-496c-96e9-3eb3977c1fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:25.945618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45491dfb-e732-496c-96e9-3eb3977c1fde None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:25.945903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45491dfb-e732-496c-96e9-3eb3977c1fde None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:25.946179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45491dfb-e732-496c-96e9-3eb3977c1fde None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:25.947065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45491dfb-e732-496c-96e9-3eb3977c1fde None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:25.947382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45491dfb-e732-496c-96e9-3eb3977c1fde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:25.953193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7126d6-aefe-4788-bf70-727e111969af None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:25.954960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45491dfb-e732-496c-96e9-3eb3977c1fde None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:25.990687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 409/819] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 12 14:18:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:25.996131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45491dfb-e732-496c-96e9-3eb3977c1fde None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:26.000722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca706845-d0a7-406c-86e5-de43b5991124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:26.001411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca706845-d0a7-406c-86e5-de43b5991124 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.001720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca706845-d0a7-406c-86e5-de43b5991124 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.002077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca706845-d0a7-406c-86e5-de43b5991124 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.002903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca706845-d0a7-406c-86e5-de43b5991124 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:26.003246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca706845-d0a7-406c-86e5-de43b5991124 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:26.005209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca706845-d0a7-406c-86e5-de43b5991124 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:26.022589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 411/820] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:26.030160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca706845-d0a7-406c-86e5-de43b5991124 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:26.156760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45491dfb-e732-496c-96e9-3eb3977c1fde None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:26.191751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca706845-d0a7-406c-86e5-de43b5991124 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:26.192426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19cd19-da63-4637-bc70-df64c146338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:26.193442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19cd19-da63-4637-bc70-df64c146338e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.193921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19cd19-da63-4637-bc70-df64c146338e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.194424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19cd19-da63-4637-bc70-df64c146338e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.205505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19cd19-da63-4637-bc70-df64c146338e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:26.207266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19cd19-da63-4637-bc70-df64c146338e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-7f19cd19-da63-4637-bc70-df64c146338e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:26.225630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:26.226707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:26.227836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:26.227836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:26.227836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:26.227836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:26.229867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 410/821] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:26.230294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d8c81-3407-44d2-b4ba-c3e1fa5303cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:26.231518 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d8c81-3407-44d2-b4ba-c3e1fa5303cc None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.231802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d8c81-3407-44d2-b4ba-c3e1fa5303cc None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.232076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d8c81-3407-44d2-b4ba-c3e1fa5303cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.232867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449b9f-6b84-40e3-bd63-083ef5a098ec None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.232971 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d8c81-3407-44d2-b4ba-c3e1fa5303cc None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=2366609a0a564e7fbcb05b503de78580) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:26.233206 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d8c81-3407-44d2-b4ba-c3e1fa5303cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:26.233625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449b9f-6b84-40e3-bd63-083ef5a098ec None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.234099 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449b9f-6b84-40e3-bd63-083ef5a098ec None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.234757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d8c81-3407-44d2-b4ba-c3e1fa5303cc None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:26.236287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 411/822] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:26.237203 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449b9f-6b84-40e3-bd63-083ef5a098ec None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:26.242560 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 412/823] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:26 2022] GET /identity/v3/role_assignments?user.id=2366609a0a564e7fbcb05b503de78580&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:26.244000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258065-933f-4642-9214-41d349c50a2c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.244296 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258065-933f-4642-9214-41d349c50a2c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.244577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258065-933f-4642-9214-41d349c50a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.269212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-51258065-933f-4642-9214-41d349c50a2c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:26.270985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-51258065-933f-4642-9214-41d349c50a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:26.415759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449b9f-6b84-40e3-bd63-083ef5a098ec None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:26.416424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 413/824] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:26.456252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258065-933f-4642-9214-41d349c50a2c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:26.460783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44ace6-f5a8-4923-9d3b-3f383ce1f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:26.461542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44ace6-f5a8-4923-9d3b-3f383ce1f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.461867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44ace6-f5a8-4923-9d3b-3f383ce1f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.462187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44ace6-f5a8-4923-9d3b-3f383ce1f1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.463023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44ace6-f5a8-4923-9d3b-3f383ce1f1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:26.463465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44ace6-f5a8-4923-9d3b-3f383ce1f1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:26.465250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44ace6-f5a8-4923-9d3b-3f383ce1f1b1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:26.482434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 412/825] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:26.488412 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44ace6-f5a8-4923-9d3b-3f383ce1f1b1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:26.597937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258065-933f-4642-9214-41d349c50a2c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:26.639640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44ace6-f5a8-4923-9d3b-3f383ce1f1b1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:26.644399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d3015-3b90-4836-abdd-9762e7ac1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:26.645203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d3015-3b90-4836-abdd-9762e7ac1c66 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.645748 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d3015-3b90-4836-abdd-9762e7ac1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.646019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d3015-3b90-4836-abdd-9762e7ac1c66 None admin] PATH_INFO: `/v3/services/network` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.646682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d3015-3b90-4836-abdd-9762e7ac1c66 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:26.648598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d3015-3b90-4836-abdd-9762e7ac1c66 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-547d3015-3b90-4836-abdd-9762e7ac1c66 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:26.664458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:26.665499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 12 14:18:26.666328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:26.667101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 414/826] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:26 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:26.676099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d3015-3b90-4836-abdd-9762e7ac1c66 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:26.704319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa0e21-32eb-459d-870e-05afa7981288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:26.705201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0e21-32eb-459d-870e-05afa7981288 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.705529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0e21-32eb-459d-870e-05afa7981288 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.705813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa0e21-32eb-459d-870e-05afa7981288 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.717781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa0e21-32eb-459d-870e-05afa7981288 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:26.719207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa0e21-32eb-459d-870e-05afa7981288 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-fbfa0e21-32eb-459d-870e-05afa7981288 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:26.734861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:26.736982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 413/827] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42433e-ab51-4ac8-ac0a-5f056f854e4d None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.739074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42433e-ab51-4ac8-ac0a-5f056f854e4d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.740444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42433e-ab51-4ac8-ac0a-5f056f854e4d None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.744391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 414/828] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:26.745945 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca493d6f-4ced-4fd8-8d2a-2ccec137da7d None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.746140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca493d6f-4ced-4fd8-8d2a-2ccec137da7d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.746304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca493d6f-4ced-4fd8-8d2a-2ccec137da7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.765897 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-ca493d6f-4ced-4fd8-8d2a-2ccec137da7d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:26.767760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ca493d6f-4ced-4fd8-8d2a-2ccec137da7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:26.785286 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d3015-3b90-4836-abdd-9762e7ac1c66 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:26.820182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94169229-850e-41e3-9b98-db7917fe1853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:26.821053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94169229-850e-41e3-9b98-db7917fe1853 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:26.821213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94169229-850e-41e3-9b98-db7917fe1853 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:26.821384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94169229-850e-41e3-9b98-db7917fe1853 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:26.822099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94169229-850e-41e3-9b98-db7917fe1853 None admin] RBAC: Adding query filter params (name=network) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:26.822401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94169229-850e-41e3-9b98-db7917fe1853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:26.823820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94169229-850e-41e3-9b98-db7917fe1853 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:26.829426 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 415/829] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:26.830265 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94169229-850e-41e3-9b98-db7917fe1853 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:26.853839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 415/830] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:26.854709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca493d6f-4ced-4fd8-8d2a-2ccec137da7d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:26.973847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94169229-850e-41e3-9b98-db7917fe1853 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:26.999678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca493d6f-4ced-4fd8-8d2a-2ccec137da7d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:27.017061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a6336-d7fe-435d-b720-b3ea4f8c9a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:27.017894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6336-d7fe-435d-b720-b3ea4f8c9a4f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:27.018345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6336-d7fe-435d-b720-b3ea4f8c9a4f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:27.018625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6336-d7fe-435d-b720-b3ea4f8c9a4f None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:27.019745 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a6336-d7fe-435d-b720-b3ea4f8c9a4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:27.020066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a6336-d7fe-435d-b720-b3ea4f8c9a4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:27.021820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a6336-d7fe-435d-b720-b3ea4f8c9a4f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:27.036521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 416/831] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:27.037522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a6336-d7fe-435d-b720-b3ea4f8c9a4f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:27.060199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cab3f-ac1a-429e-96f3-4fc3b0b30f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:27.061779 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cab3f-ac1a-429e-96f3-4fc3b0b30f7d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:27.062564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cab3f-ac1a-429e-96f3-4fc3b0b30f7d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:27.063408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cab3f-ac1a-429e-96f3-4fc3b0b30f7d None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:27.064951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cab3f-ac1a-429e-96f3-4fc3b0b30f7d None admin] RBAC: Adding query filter params (type=network) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:27.065723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cab3f-ac1a-429e-96f3-4fc3b0b30f7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:27.068586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cab3f-ac1a-429e-96f3-4fc3b0b30f7d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:27.078235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 416/832] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:27.080176 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cab3f-ac1a-429e-96f3-4fc3b0b30f7d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:27.143343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a6336-d7fe-435d-b720-b3ea4f8c9a4f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:27.180213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb113eb8-5494-499f-a5eb-11a798bf9d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:27.181022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb113eb8-5494-499f-a5eb-11a798bf9d45 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:27.181370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb113eb8-5494-499f-a5eb-11a798bf9d45 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:27.181645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb113eb8-5494-499f-a5eb-11a798bf9d45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:27.192789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb113eb8-5494-499f-a5eb-11a798bf9d45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-bb113eb8-5494-499f-a5eb-11a798bf9d45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:27.201130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:27.202861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:27.204502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:27.207356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 417/833] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:27.208224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb113eb8-5494-499f-a5eb-11a798bf9d45 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:27.262469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cab3f-ac1a-429e-96f3-4fc3b0b30f7d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:27.316831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb113eb8-5494-499f-a5eb-11a798bf9d45 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:27.322020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab06ac-b464-4fb7-9a3e-44f39e3969d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:27.324086 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab06ac-b464-4fb7-9a3e-44f39e3969d3 None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:27.324936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab06ac-b464-4fb7-9a3e-44f39e3969d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:27.325711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab06ac-b464-4fb7-9a3e-44f39e3969d3 None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/599088a56dbf4c4b9aba49fcbfce8362/roles/74e0a16c92f749e793a06bd6cbb9b2b6` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:27.354182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab06ac-b464-4fb7-9a3e-44f39e3969d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=599088a56dbf4c4b9aba49fcbfce8362, role_id=74e0a16c92f749e793a06bd6cbb9b2b6)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:27.356893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209de7b-076d-4235-9d17-6d20c049656d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:27.357619 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209de7b-076d-4235-9d17-6d20c049656d None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:27.357909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209de7b-076d-4235-9d17-6d20c049656d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:27.358189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209de7b-076d-4235-9d17-6d20c049656d None admin] PATH_INFO: `/v3/endpoints` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:27.358942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209de7b-076d-4235-9d17-6d20c049656d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:27.359466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab06ac-b464-4fb7-9a3e-44f39e3969d3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:27.360414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209de7b-076d-4235-9d17-6d20c049656d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:27.383645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 418/834] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 12 14:18:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:27.384601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209de7b-076d-4235-9d17-6d20c049656d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:27.390135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 417/835] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:18:27 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/599088a56dbf4c4b9aba49fcbfce8362/roles/74e0a16c92f749e793a06bd6cbb9b2b6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:18:27.516488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209de7b-076d-4235-9d17-6d20c049656d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:27.563988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18df5b-0dd1-4412-a63c-8dfd8cc81114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:27.564702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18df5b-0dd1-4412-a63c-8dfd8cc81114 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:27.564991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18df5b-0dd1-4412-a63c-8dfd8cc81114 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:27.565275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18df5b-0dd1-4412-a63c-8dfd8cc81114 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:27.566072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18df5b-0dd1-4412-a63c-8dfd8cc81114 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:27.566460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18df5b-0dd1-4412-a63c-8dfd8cc81114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:27.568014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18df5b-0dd1-4412-a63c-8dfd8cc81114 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:27.583353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 419/836] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:18:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:27.585538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab06ac-b464-4fb7-9a3e-44f39e3969d3 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:27.738216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab06ac-b464-4fb7-9a3e-44f39e3969d3 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:27.774380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d08d8-6353-49b8-b814-30100698aec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:27.775575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d08d8-6353-49b8-b814-30100698aec9 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:27.776069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d08d8-6353-49b8-b814-30100698aec9 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:27.776588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d08d8-6353-49b8-b814-30100698aec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:27.787961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d08d8-6353-49b8-b814-30100698aec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:27.789785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d08d8-6353-49b8-b814-30100698aec9 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-123d08d8-6353-49b8-b814-30100698aec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:27.809704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:27.810662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:27.811625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:27.811625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:27.811625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:27.811625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:27.817157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 418/837] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:27.820447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18df5b-0dd1-4412-a63c-8dfd8cc81114 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:27.927675 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18df5b-0dd1-4412-a63c-8dfd8cc81114 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:27.964077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafc5ce-094d-475f-9996-f9d64ac76005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:27.971063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafc5ce-094d-475f-9996-f9d64ac76005 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:27.971063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafc5ce-094d-475f-9996-f9d64ac76005 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:27.971063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafc5ce-094d-475f-9996-f9d64ac76005 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:27.971063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafc5ce-094d-475f-9996-f9d64ac76005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:27.971063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafc5ce-094d-475f-9996-f9d64ac76005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:27.971063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafc5ce-094d-475f-9996-f9d64ac76005 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:27.987423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 420/838] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:27.989140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d08d8-6353-49b8-b814-30100698aec9 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:28.092995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d08d8-6353-49b8-b814-30100698aec9 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:28.129642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e2cac-a7de-401d-9cf0-b83b25065f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:28.130439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e2cac-a7de-401d-9cf0-b83b25065f0d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:28.130717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e2cac-a7de-401d-9cf0-b83b25065f0d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:28.130985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e2cac-a7de-401d-9cf0-b83b25065f0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:28.138602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e2cac-a7de-401d-9cf0-b83b25065f0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:28.140153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e2cac-a7de-401d-9cf0-b83b25065f0d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-365e2cac-a7de-401d-9cf0-b83b25065f0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:28.155787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:28.156806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:28.157811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 419/839] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:28.162789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafc5ce-094d-475f-9996-f9d64ac76005 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:28.267850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafc5ce-094d-475f-9996-f9d64ac76005 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:28.302804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01962f76-e006-47db-a089-016c8f810b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:28.303584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962f76-e006-47db-a089-016c8f810b64 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:28.303868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962f76-e006-47db-a089-016c8f810b64 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:28.304144 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962f76-e006-47db-a089-016c8f810b64 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:28.304995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01962f76-e006-47db-a089-016c8f810b64 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:28.305301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01962f76-e006-47db-a089-016c8f810b64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:28.306752 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01962f76-e006-47db-a089-016c8f810b64 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:28.330545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 421/840] 10.222.0.75 () {56 vars in 1135 bytes} [Thu May 12 14:18:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:28.332131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e2cac-a7de-401d-9cf0-b83b25065f0d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:28.442688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e2cac-a7de-401d-9cf0-b83b25065f0d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:28.478889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa551-6306-4709-958a-75e8a670a576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:28.479588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa551-6306-4709-958a-75e8a670a576 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:28.479875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa551-6306-4709-958a-75e8a670a576 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:28.480147 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa551-6306-4709-958a-75e8a670a576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:28.552076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa551-6306-4709-958a-75e8a670a576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:28.553550 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa551-6306-4709-958a-75e8a670a576 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:28.565199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda2b4-aa4f-4ed4-bc11-db1b39970e85 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:28.567072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda2b4-aa4f-4ed4-bc11-db1b39970e85 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:28.567371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdda2b4-aa4f-4ed4-bc11-db1b39970e85 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:28.569333 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 422/841] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:28.576171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf076217-7693-42f3-bad9-d7bcab6a796a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:28.576450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf076217-7693-42f3-bad9-d7bcab6a796a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:28.576736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf076217-7693-42f3-bad9-d7bcab6a796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:28.598866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-bf076217-7693-42f3-bad9-d7bcab6a796a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:28.600113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-bf076217-7693-42f3-bad9-d7bcab6a796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:28.695216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 420/842] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:18:28.697545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 423/843] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:28.698548 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa551-6306-4709-958a-75e8a670a576 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:28.728243 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf076217-7693-42f3-bad9-d7bcab6a796a None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:28.845074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa551-6306-4709-958a-75e8a670a576 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:28.847951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf076217-7693-42f3-bad9-d7bcab6a796a None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:28.889090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc4174-02ab-46cd-ace0-270f2e6eedf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:28.889934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7696af-8a76-460b-a844-0896513c362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:28.890059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc4174-02ab-46cd-ace0-270f2e6eedf8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:28.890375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc4174-02ab-46cd-ace0-270f2e6eedf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:28.890725 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc4174-02ab-46cd-ace0-270f2e6eedf8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:28.891453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7696af-8a76-460b-a844-0896513c362d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:28.891576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc4174-02ab-46cd-ace0-270f2e6eedf8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:28.892024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7696af-8a76-460b-a844-0896513c362d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:28.892478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7696af-8a76-460b-a844-0896513c362d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:28.893099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc4174-02ab-46cd-ace0-270f2e6eedf8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:28.904895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7696af-8a76-460b-a844-0896513c362d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-24dc4174-02ab-46cd-ace0-270f2e6eedf8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:28.906435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:28.907554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:18:28.908399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:28.909831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7696af-8a76-460b-a844-0896513c362d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:28.913094 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 424/844] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:18:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:28.914146 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc4174-02ab-46cd-ace0-270f2e6eedf8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-ac7696af-8a76-460b-a844-0896513c362d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:28.931490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:28.932488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:28.933379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:28.933379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:28.933379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:28.933379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:28.940612 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 421/845] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:28.942460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7696af-8a76-460b-a844-0896513c362d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:29.054288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc4174-02ab-46cd-ace0-270f2e6eedf8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:29.071477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7696af-8a76-460b-a844-0896513c362d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:29.107692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c2b69-35fb-46e4-b260-bbcc2c0b3081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:29.108485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c2b69-35fb-46e4-b260-bbcc2c0b3081 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.108843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c2b69-35fb-46e4-b260-bbcc2c0b3081 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.109193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c2b69-35fb-46e4-b260-bbcc2c0b3081 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.109994 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c2b69-35fb-46e4-b260-bbcc2c0b3081 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:29.110598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c2b69-35fb-46e4-b260-bbcc2c0b3081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:29.111442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1d08-3d4e-4419-9325-02bc09183fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:29.112311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1d08-3d4e-4419-9325-02bc09183fce None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.112774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1d08-3d4e-4419-9325-02bc09183fce None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.113249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1d08-3d4e-4419-9325-02bc09183fce None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.113498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c2b69-35fb-46e4-b260-bbcc2c0b3081 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:29.114364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1d08-3d4e-4419-9325-02bc09183fce None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:29.114856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1d08-3d4e-4419-9325-02bc09183fce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:29.116483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1d08-3d4e-4419-9325-02bc09183fce None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:29.125219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 425/846] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:18:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:29.127208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c2b69-35fb-46e4-b260-bbcc2c0b3081 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:29.136849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 422/847] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:29.139065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1d08-3d4e-4419-9325-02bc09183fce None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:29.232299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c2b69-35fb-46e4-b260-bbcc2c0b3081 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:29.254317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1d08-3d4e-4419-9325-02bc09183fce None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:29.272205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8296e95-ecf2-48ba-87f4-1d00c93e6915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:29.272879 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296e95-ecf2-48ba-87f4-1d00c93e6915 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.273186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296e95-ecf2-48ba-87f4-1d00c93e6915 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.273461 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8296e95-ecf2-48ba-87f4-1d00c93e6915 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.274170 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8296e95-ecf2-48ba-87f4-1d00c93e6915 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:29.274475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8296e95-ecf2-48ba-87f4-1d00c93e6915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:29.275902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8296e95-ecf2-48ba-87f4-1d00c93e6915 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:29.281489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 426/848] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:18:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:29.282798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b96ec-3eb6-4c49-bf46-90c0b6473fd3 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.283107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b96ec-3eb6-4c49-bf46-90c0b6473fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.283383 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b96ec-3eb6-4c49-bf46-90c0b6473fd3 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.284809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 427/849] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:29.290549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d469d-bf4e-4d09-bc25-00d87e6e3b4f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.290847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d469d-bf4e-4d09-bc25-00d87e6e3b4f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.291137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d469d-bf4e-4d09-bc25-00d87e6e3b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.314967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d02b77-e44b-41a4-a559-705424111e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:29.316214 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d02b77-e44b-41a4-a559-705424111e5b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.316445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-5f2d469d-bf4e-4d09-bc25-00d87e6e3b4f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:29.316943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d02b77-e44b-41a4-a559-705424111e5b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.317448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d02b77-e44b-41a4-a559-705424111e5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.318283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5f2d469d-bf4e-4d09-bc25-00d87e6e3b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:29.330881 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d02b77-e44b-41a4-a559-705424111e5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:29.332808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d02b77-e44b-41a4-a559-705424111e5b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-e8d02b77-e44b-41a4-a559-705424111e5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:29.352395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:29.353362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:29.354325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:29.354325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:29.354325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:29.354325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:29.354325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:29.354325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:29.354325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:29.354325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:29.358050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 423/850] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:29.370110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d02b77-e44b-41a4-a559-705424111e5b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:29.437800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 428/851] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:29.474219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d469d-bf4e-4d09-bc25-00d87e6e3b4f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:29.524163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d02b77-e44b-41a4-a559-705424111e5b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:29.581232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce5d5-6ccf-4ab0-9238-b2d05e144ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:29.581927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce5d5-6ccf-4ab0-9238-b2d05e144ff1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.583180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce5d5-6ccf-4ab0-9238-b2d05e144ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.583180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce5d5-6ccf-4ab0-9238-b2d05e144ff1 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.583325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ce5d5-6ccf-4ab0-9238-b2d05e144ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:29.583602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ce5d5-6ccf-4ab0-9238-b2d05e144ff1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:29.585096 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ce5d5-6ccf-4ab0-9238-b2d05e144ff1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:29.599152 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 424/852] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:29.599540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d469d-bf4e-4d09-bc25-00d87e6e3b4f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:29.608126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce5d5-6ccf-4ab0-9238-b2d05e144ff1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:29.638355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e19c03-9e0c-4be0-b273-e285d0d1c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:29.639576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e19c03-9e0c-4be0-b273-e285d0d1c09c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.640084 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e19c03-9e0c-4be0-b273-e285d0d1c09c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.640570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e19c03-9e0c-4be0-b273-e285d0d1c09c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.641435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e19c03-9e0c-4be0-b273-e285d0d1c09c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:29.643118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e19c03-9e0c-4be0-b273-e285d0d1c09c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-e6e19c03-9e0c-4be0-b273-e285d0d1c09c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:29.656643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:29.657665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:18:29.658510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:29.661554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 429/853] 10.222.0.75 () {56 vars in 1132 bytes} [Thu May 12 14:18:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:29.667205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e19c03-9e0c-4be0-b273-e285d0d1c09c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:29.721017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce5d5-6ccf-4ab0-9238-b2d05e144ff1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:29.763830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32ee9-9f13-42e2-a398-6a26fefcb651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:29.764892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32ee9-9f13-42e2-a398-6a26fefcb651 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.765179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32ee9-9f13-42e2-a398-6a26fefcb651 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.765458 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf32ee9-9f13-42e2-a398-6a26fefcb651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.766336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf32ee9-9f13-42e2-a398-6a26fefcb651 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=2893125208864a1ab2c32e50d5da3f83) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:29.766648 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf32ee9-9f13-42e2-a398-6a26fefcb651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:29.768214 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf32ee9-9f13-42e2-a398-6a26fefcb651 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:29.783281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 425/854] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:29 2022] GET /identity/v3/role_assignments?user.id=2893125208864a1ab2c32e50d5da3f83&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:29.793937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e19c03-9e0c-4be0-b273-e285d0d1c09c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:29.832523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0b930-c601-43e6-9cca-733c4785b24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:29.833207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0b930-c601-43e6-9cca-733c4785b24b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.833491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0b930-c601-43e6-9cca-733c4785b24b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.833770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0b930-c601-43e6-9cca-733c4785b24b None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.834549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0b930-c601-43e6-9cca-733c4785b24b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:29.834865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0b930-c601-43e6-9cca-733c4785b24b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:29.836357 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0b930-c601-43e6-9cca-733c4785b24b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:29.842628 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 430/855] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:29.851387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32ee9-9f13-42e2-a398-6a26fefcb651 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:29.951755 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e69dd7-73d8-439c-bda9-a480d2790418 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.952669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e69dd7-73d8-439c-bda9-a480d2790418 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.953603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e69dd7-73d8-439c-bda9-a480d2790418 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.956042 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 431/856] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:29.961508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2155f-63c2-4063-947e-435f368f194f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:29.961815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2155f-63c2-4063-947e-435f368f194f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:29.962064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2155f-63c2-4063-947e-435f368f194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:29.983693 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf32ee9-9f13-42e2-a398-6a26fefcb651 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:29.988006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-67d2155f-63c2-4063-947e-435f368f194f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:29.989235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-67d2155f-63c2-4063-947e-435f368f194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:30.039129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e7923-b220-45c9-87fb-b79af85b7973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:30.041377 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e7923-b220-45c9-87fb-b79af85b7973 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:30.041675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e7923-b220-45c9-87fb-b79af85b7973 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:30.041955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e7923-b220-45c9-87fb-b79af85b7973 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:30.042937 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e7923-b220-45c9-87fb-b79af85b7973 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:30.043420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e7923-b220-45c9-87fb-b79af85b7973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:30.044828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e7923-b220-45c9-87fb-b79af85b7973 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:30.050870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 426/857] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:30.081885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 432/858] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:30.106802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e7923-b220-45c9-87fb-b79af85b7973 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:30.226133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e7923-b220-45c9-87fb-b79af85b7973 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:30.273671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c3b96-777a-4290-b6e4-625c86e73763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:30.274487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3b96-777a-4290-b6e4-625c86e73763 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:30.274770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3b96-777a-4290-b6e4-625c86e73763 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:30.275059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c3b96-777a-4290-b6e4-625c86e73763 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:30.286756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c3b96-777a-4290-b6e4-625c86e73763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-fc0c3b96-777a-4290-b6e4-625c86e73763 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:30.295530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:30.297501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:30.298599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 427/859] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:18:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:30.302523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2155f-63c2-4063-947e-435f368f194f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:30.440506 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2155f-63c2-4063-947e-435f368f194f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:30.479529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb29ad-5582-4cda-a185-32532aca737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:30.480216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb29ad-5582-4cda-a185-32532aca737f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:30.480501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb29ad-5582-4cda-a185-32532aca737f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:30.481351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb29ad-5582-4cda-a185-32532aca737f None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:30.482121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb29ad-5582-4cda-a185-32532aca737f None admin] RBAC: Adding query filter params (name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:30.482577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb29ad-5582-4cda-a185-32532aca737f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:30.485374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb29ad-5582-4cda-a185-32532aca737f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:30.496468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 433/860] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:18:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:30.501667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c3b96-777a-4290-b6e4-625c86e73763 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:30.612854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c3b96-777a-4290-b6e4-625c86e73763 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:30.648171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fc6e3-615f-45f8-aff8-2afe0d3fb8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:30.648973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fc6e3-615f-45f8-aff8-2afe0d3fb8cf None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:30.649254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fc6e3-615f-45f8-aff8-2afe0d3fb8cf None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:30.649524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fc6e3-615f-45f8-aff8-2afe0d3fb8cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:30.661856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fc6e3-615f-45f8-aff8-2afe0d3fb8cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:30.663356 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714fc6e3-615f-45f8-aff8-2afe0d3fb8cf None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-714fc6e3-615f-45f8-aff8-2afe0d3fb8cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:30.681917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:30.684107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:30.685795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:30.685795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:30.685795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:30.685795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:30.685795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 428/861] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:30.688798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb29ad-5582-4cda-a185-32532aca737f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:30.815733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb29ad-5582-4cda-a185-32532aca737f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:30.852230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cda6d-eaf0-4cd1-81f9-459b387193dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:30.852982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cda6d-eaf0-4cd1-81f9-459b387193dd None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:30.853272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cda6d-eaf0-4cd1-81f9-459b387193dd None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:30.853594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cda6d-eaf0-4cd1-81f9-459b387193dd None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:30.854449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cda6d-eaf0-4cd1-81f9-459b387193dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:30.854761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cda6d-eaf0-4cd1-81f9-459b387193dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:30.856975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cda6d-eaf0-4cd1-81f9-459b387193dd None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:30.870056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 434/862] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:30.876096 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fc6e3-615f-45f8-aff8-2afe0d3fb8cf None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:30.981259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fc6e3-615f-45f8-aff8-2afe0d3fb8cf None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:31.016273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7484f39-31a4-4e03-a794-32d1ebff5029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:31.017092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484f39-31a4-4e03-a794-32d1ebff5029 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:31.017560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484f39-31a4-4e03-a794-32d1ebff5029 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:31.017840 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7484f39-31a4-4e03-a794-32d1ebff5029 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:31.026272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7484f39-31a4-4e03-a794-32d1ebff5029 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:31.028562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7484f39-31a4-4e03-a794-32d1ebff5029 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-a7484f39-31a4-4e03-a794-32d1ebff5029 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:31.043543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:31.045703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:31.047934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 429/863] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 12 14:18:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:31.052178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cda6d-eaf0-4cd1-81f9-459b387193dd None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:31.174299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cda6d-eaf0-4cd1-81f9-459b387193dd None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:31.219647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae59e9-9a80-4f47-b582-3a3c79e5afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:31.220330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae59e9-9a80-4f47-b582-3a3c79e5afb5 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:31.220615 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae59e9-9a80-4f47-b582-3a3c79e5afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:31.220894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae59e9-9a80-4f47-b582-3a3c79e5afb5 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:31.221753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae59e9-9a80-4f47-b582-3a3c79e5afb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:31.222068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae59e9-9a80-4f47-b582-3a3c79e5afb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:31.223559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae59e9-9a80-4f47-b582-3a3c79e5afb5 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:31.246973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 435/864] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 12 14:18:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:31.252285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7484f39-31a4-4e03-a794-32d1ebff5029 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:31.358625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7484f39-31a4-4e03-a794-32d1ebff5029 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:31.393517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cafe7-9a73-485a-93b7-219bd832f90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:31.394174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cafe7-9a73-485a-93b7-219bd832f90d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:31.394458 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cafe7-9a73-485a-93b7-219bd832f90d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:31.394737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cafe7-9a73-485a-93b7-219bd832f90d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:31.466753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cafe7-9a73-485a-93b7-219bd832f90d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:31.468196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cafe7-9a73-485a-93b7-219bd832f90d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:31.570380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 430/865] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:18:31.576562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae59e9-9a80-4f47-b582-3a3c79e5afb5 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:31.687601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae59e9-9a80-4f47-b582-3a3c79e5afb5 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:31.724076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756f27c-dbbb-40a8-993e-c0ab4be3521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:31.724804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756f27c-dbbb-40a8-993e-c0ab4be3521f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:31.725083 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756f27c-dbbb-40a8-993e-c0ab4be3521f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:31.725354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756f27c-dbbb-40a8-993e-c0ab4be3521f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:31.736382 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756f27c-dbbb-40a8-993e-c0ab4be3521f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:31.737874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756f27c-dbbb-40a8-993e-c0ab4be3521f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-3756f27c-dbbb-40a8-993e-c0ab4be3521f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:31.756432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:31.758136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:31.759076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:31.759076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:31.759076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:31.759076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:31.759076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 436/866] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:31.764000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cafe7-9a73-485a-93b7-219bd832f90d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:31.869602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cafe7-9a73-485a-93b7-219bd832f90d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:31.878240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8322930-df10-464e-a002-da603af7e856 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:31.878521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8322930-df10-464e-a002-da603af7e856 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:31.879059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8322930-df10-464e-a002-da603af7e856 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:31.881467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 437/867] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:31.889047 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634fcea-7fa3-4fc1-b07b-cc415504e29a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:31.889637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634fcea-7fa3-4fc1-b07b-cc415504e29a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:31.890154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634fcea-7fa3-4fc1-b07b-cc415504e29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:31.907831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d634fcea-7fa3-4fc1-b07b-cc415504e29a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:31.909460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d634fcea-7fa3-4fc1-b07b-cc415504e29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:31.909814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d9bc-cc0b-4ec0-8335-fc9b8417ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:31.910496 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d9bc-cc0b-4ec0-8335-fc9b8417ee50 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:31.910785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d9bc-cc0b-4ec0-8335-fc9b8417ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:31.911066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d9bc-cc0b-4ec0-8335-fc9b8417ee50 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:31.911807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118d9bc-cc0b-4ec0-8335-fc9b8417ee50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:31.912110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118d9bc-cc0b-4ec0-8335-fc9b8417ee50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:31.913623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118d9bc-cc0b-4ec0-8335-fc9b8417ee50 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:31.930281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 431/868] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:31.932658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d9bc-cc0b-4ec0-8335-fc9b8417ee50 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:32.001750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 438/869] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:32.024586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634fcea-7fa3-4fc1-b07b-cc415504e29a None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:32.072667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d9bc-cc0b-4ec0-8335-fc9b8417ee50 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:32.118923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920371-8cf5-4627-a990-398c440671d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:32.119763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920371-8cf5-4627-a990-398c440671d5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.120045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920371-8cf5-4627-a990-398c440671d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.120321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920371-8cf5-4627-a990-398c440671d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.131119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f920371-8cf5-4627-a990-398c440671d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:32.133144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f920371-8cf5-4627-a990-398c440671d5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:32.135816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634fcea-7fa3-4fc1-b07b-cc415504e29a None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-3f920371-8cf5-4627-a990-398c440671d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:32.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:32.153922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:32.154814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:32.154814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:32.154814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:32.154814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:32.154814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:32.154814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:32.154814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:32.154814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:32.159180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 432/870] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:32.160547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920371-8cf5-4627-a990-398c440671d5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:32.181216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b523920-a8f6-4f71-8ab2-e2f4a833e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:32.181888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b523920-a8f6-4f71-8ab2-e2f4a833e057 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.182173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b523920-a8f6-4f71-8ab2-e2f4a833e057 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.182453 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b523920-a8f6-4f71-8ab2-e2f4a833e057 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.183215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b523920-a8f6-4f71-8ab2-e2f4a833e057 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:32.185152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b523920-a8f6-4f71-8ab2-e2f4a833e057 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:32.223072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 439/871] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:18:32 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:18:32.259490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab3c7-3ad5-4652-9c29-bd5a3e6b1f5f None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.259706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab3c7-3ad5-4652-9c29-bd5a3e6b1f5f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.259952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dab3c7-3ad5-4652-9c29-bd5a3e6b1f5f None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.267260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 440/872] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:32.270031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf7a2a-0592-4439-9807-b0aed8fc5979 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.270583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf7a2a-0592-4439-9807-b0aed8fc5979 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.270848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf7a2a-0592-4439-9807-b0aed8fc5979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.288993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-edcf7a2a-0592-4439-9807-b0aed8fc5979 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:32.290227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-edcf7a2a-0592-4439-9807-b0aed8fc5979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:32.311990 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920371-8cf5-4627-a990-398c440671d5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:32.368893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405cc12-602f-40c5-b6d0-ab1ef22c6e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:32.369697 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405cc12-602f-40c5-b6d0-ab1ef22c6e91 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.370149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405cc12-602f-40c5-b6d0-ab1ef22c6e91 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.370572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405cc12-602f-40c5-b6d0-ab1ef22c6e91 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.371665 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405cc12-602f-40c5-b6d0-ab1ef22c6e91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:32.372133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405cc12-602f-40c5-b6d0-ab1ef22c6e91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:32.373808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405cc12-602f-40c5-b6d0-ab1ef22c6e91 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:32.379524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 441/873] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:32.388680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 433/874] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:32.394588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf7a2a-0592-4439-9807-b0aed8fc5979 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:32.399067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405cc12-602f-40c5-b6d0-ab1ef22c6e91 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:32.522618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf7a2a-0592-4439-9807-b0aed8fc5979 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:32.532878 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405cc12-602f-40c5-b6d0-ab1ef22c6e91 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:32.557167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa02459-36e5-408d-b04b-99fb47199eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:32.557835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02459-36e5-408d-b04b-99fb47199eea None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.558114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02459-36e5-408d-b04b-99fb47199eea None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.558406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa02459-36e5-408d-b04b-99fb47199eea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.559819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa02459-36e5-408d-b04b-99fb47199eea None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=599088a56dbf4c4b9aba49fcbfce8362) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:32.560128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa02459-36e5-408d-b04b-99fb47199eea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:32.561589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa02459-36e5-408d-b04b-99fb47199eea None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:32.567833 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 442/875] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:32 2022] GET /identity/v3/role_assignments?user.id=599088a56dbf4c4b9aba49fcbfce8362&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:32.569505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aaf5b-46d5-4d56-be44-8e92fa07bf27 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.569976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aaf5b-46d5-4d56-be44-8e92fa07bf27 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.570433 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aaf5b-46d5-4d56-be44-8e92fa07bf27 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.572297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 443/876] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:32.577012 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc67f10-3bd8-431c-a5df-23883f0539cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:32.578794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc67f10-3bd8-431c-a5df-23883f0539cf None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.578929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858c1f-1f92-4cdd-a54c-ef9c8851ec0c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.579185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc67f10-3bd8-431c-a5df-23883f0539cf None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.579554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc67f10-3bd8-431c-a5df-23883f0539cf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.579785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858c1f-1f92-4cdd-a54c-ef9c8851ec0c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.580266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858c1f-1f92-4cdd-a54c-ef9c8851ec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.580415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc67f10-3bd8-431c-a5df-23883f0539cf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:32.581967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc67f10-3bd8-431c-a5df-23883f0539cf None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-ecc67f10-3bd8-431c-a5df-23883f0539cf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:32.595318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:32.596410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:32.602680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 434/877] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:32.605312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc67f10-3bd8-431c-a5df-23883f0539cf None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:32.606199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-0a858c1f-1f92-4cdd-a54c-ef9c8851ec0c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:32.607734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0a858c1f-1f92-4cdd-a54c-ef9c8851ec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:32.711378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 444/878] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:32.727834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858c1f-1f92-4cdd-a54c-ef9c8851ec0c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:32.735454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc67f10-3bd8-431c-a5df-23883f0539cf None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:32.778682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26770c5-7671-4710-b609-45a6e840c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:32.779774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26770c5-7671-4710-b609-45a6e840c33a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.780269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26770c5-7671-4710-b609-45a6e840c33a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.780750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26770c5-7671-4710-b609-45a6e840c33a None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.781687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26770c5-7671-4710-b609-45a6e840c33a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:32.782221 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26770c5-7671-4710-b609-45a6e840c33a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:32.783904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26770c5-7671-4710-b609-45a6e840c33a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:32.794720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 435/879] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 12 14:18:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:32.797765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26770c5-7671-4710-b609-45a6e840c33a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:32.845002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858c1f-1f92-4cdd-a54c-ef9c8851ec0c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:32.891385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2a96-7377-40dc-ab24-614a7499e866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:32.892401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2a96-7377-40dc-ab24-614a7499e866 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.892862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2a96-7377-40dc-ab24-614a7499e866 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.893312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2a96-7377-40dc-ab24-614a7499e866 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.894765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad2a96-7377-40dc-ab24-614a7499e866 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:32.896661 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad2a96-7377-40dc-ab24-614a7499e866 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:32.915678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 445/880] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:18:32 2022] POST /identity/v3/services => generated 269 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:32.928722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26770c5-7671-4710-b609-45a6e840c33a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:32.990829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a07c89-4c4e-4219-8744-00d8b7f7f6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:32.991849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a07c89-4c4e-4219-8744-00d8b7f7f6b1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:32.992310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a07c89-4c4e-4219-8744-00d8b7f7f6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:32.992819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a07c89-4c4e-4219-8744-00d8b7f7f6b1 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:32.993691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a07c89-4c4e-4219-8744-00d8b7f7f6b1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:32.994151 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a07c89-4c4e-4219-8744-00d8b7f7f6b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:32.996780 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a07c89-4c4e-4219-8744-00d8b7f7f6b1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:33.003879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 436/881] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 12 14:18:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:34.542779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb4292-1654-46df-8507-88e515ab6583 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:34.543880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb4292-1654-46df-8507-88e515ab6583 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:34.543880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb4292-1654-46df-8507-88e515ab6583 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:34.545491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 446/882] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:34.551139 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dda54-38b5-46f3-9401-b6dd2d3d93d3 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:34.551592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dda54-38b5-46f3-9401-b6dd2d3d93d3 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:34.551741 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dda54-38b5-46f3-9401-b6dd2d3d93d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:34.572134 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-de4dda54-38b5-46f3-9401-b6dd2d3d93d3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:34.573728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-de4dda54-38b5-46f3-9401-b6dd2d3d93d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:34.656243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 437/883] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:34.678036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb4292-1654-46df-8507-88e515ab6583 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:34.785363 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb4292-1654-46df-8507-88e515ab6583 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:34.821686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215db1-92db-478d-898c-35516496d1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:34.822495 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215db1-92db-478d-898c-35516496d1f2 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:34.822775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215db1-92db-478d-898c-35516496d1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:34.823063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99215db1-92db-478d-898c-35516496d1f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:34.823730 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99215db1-92db-478d-898c-35516496d1f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:34.825159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99215db1-92db-478d-898c-35516496d1f2 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-99215db1-92db-478d-898c-35516496d1f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:34.837334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:34.838374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:34.839431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 447/884] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:18:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:34.845104 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dda54-38b5-46f3-9401-b6dd2d3d93d3 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:34.956277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dda54-38b5-46f3-9401-b6dd2d3d93d3 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:34.994775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e5509-f6dc-4a80-9698-b013c549610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:34.995634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e5509-f6dc-4a80-9698-b013c549610f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:34.995922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e5509-f6dc-4a80-9698-b013c549610f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:34.996278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e5509-f6dc-4a80-9698-b013c549610f None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:34.997074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e5509-f6dc-4a80-9698-b013c549610f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:34.997385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e5509-f6dc-4a80-9698-b013c549610f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:34.998810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e5509-f6dc-4a80-9698-b013c549610f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:35.004819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 438/885] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:18:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:35.010349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215db1-92db-478d-898c-35516496d1f2 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:35.116196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99215db1-92db-478d-898c-35516496d1f2 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:35.153409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeae7df-a6e2-4d74-85cf-1d81990703f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:35.154501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeae7df-a6e2-4d74-85cf-1d81990703f8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.155019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeae7df-a6e2-4d74-85cf-1d81990703f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.155715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeae7df-a6e2-4d74-85cf-1d81990703f8 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.157158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeae7df-a6e2-4d74-85cf-1d81990703f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:35.157746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeae7df-a6e2-4d74-85cf-1d81990703f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:35.159469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeae7df-a6e2-4d74-85cf-1d81990703f8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:35.166025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 448/886] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:18:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:35.173224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e5509-f6dc-4a80-9698-b013c549610f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:35.197847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b6f2f-1b38-4448-ab58-603b0a31c2c7 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.198489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b6f2f-1b38-4448-ab58-603b0a31c2c7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.199020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b6f2f-1b38-4448-ab58-603b0a31c2c7 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.201365 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 449/887] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:35.206770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14199d9-0fc8-4062-9310-8c48b1d4ea3e None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.207541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14199d9-0fc8-4062-9310-8c48b1d4ea3e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.208032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14199d9-0fc8-4062-9310-8c48b1d4ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.224822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d14199d9-0fc8-4062-9310-8c48b1d4ea3e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:35.226344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d14199d9-0fc8-4062-9310-8c48b1d4ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:35.286406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e5509-f6dc-4a80-9698-b013c549610f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:35.307175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 450/888] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:35.329056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14199d9-0fc8-4062-9310-8c48b1d4ea3e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:35.338845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc0af9-faad-4b4b-a4c7-c5197c5731f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:35.340920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0af9-faad-4b4b-a4c7-c5197c5731f1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.341444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0af9-faad-4b4b-a4c7-c5197c5731f1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.342239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0af9-faad-4b4b-a4c7-c5197c5731f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.343660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc0af9-faad-4b4b-a4c7-c5197c5731f1 None admin] RBAC: Adding query filter params (interface=public, service_id=b9f2180d855f4b70b6e3070de47e73cc, region_id=RegionOne) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:35.344183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc0af9-faad-4b4b-a4c7-c5197c5731f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:35.346635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc0af9-faad-4b4b-a4c7-c5197c5731f1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:35.357705 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 439/889] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 12 14:18:35 2022] GET /identity/v3/endpoints?service_id=b9f2180d855f4b70b6e3070de47e73cc&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:35.358756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc0af9-faad-4b4b-a4c7-c5197c5731f1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:35.435876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14199d9-0fc8-4062-9310-8c48b1d4ea3e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:35.457311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc0af9-faad-4b4b-a4c7-c5197c5731f1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:35.470008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455b337-976d-4dd6-a8bb-37a2f89ca4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:35.470819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b337-976d-4dd6-a8bb-37a2f89ca4cf None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.471142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b337-976d-4dd6-a8bb-37a2f89ca4cf None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.471423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455b337-976d-4dd6-a8bb-37a2f89ca4cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.482441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455b337-976d-4dd6-a8bb-37a2f89ca4cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-f455b337-976d-4dd6-a8bb-37a2f89ca4cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:35.490586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:35.491603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:18:35.492436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:35.493080 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c2500-d23e-4e56-b5b4-5de1bed29717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:35.493167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 451/890] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 12 14:18:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:35.493235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2500-d23e-4e56-b5b4-5de1bed29717 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.493235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2500-d23e-4e56-b5b4-5de1bed29717 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.493235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2500-d23e-4e56-b5b4-5de1bed29717 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.493419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fcfc2-16d7-4cb1-abf4-2f432debdc6d None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.493419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fcfc2-16d7-4cb1-abf4-2f432debdc6d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.493873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fcfc2-16d7-4cb1-abf4-2f432debdc6d None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.493970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2500-d23e-4e56-b5b4-5de1bed29717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:35.495001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 452/891] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:35.495930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b9ed5-6295-4cc5-833d-aa72195312d8 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.497697 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2500-d23e-4e56-b5b4-5de1bed29717 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:35.497830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b9ed5-6295-4cc5-833d-aa72195312d8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.497830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b9ed5-6295-4cc5-833d-aa72195312d8 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.499074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 453/892] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:35.499074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b9ed5-6295-4cc5-833d-aa72195312d8 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:35.506689 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 440/893] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 12 14:18:35 2022] GET /identity/v3/services => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:18:35.508048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32e9b-9081-4ff7-8011-8657c7252fce None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.508344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32e9b-9081-4ff7-8011-8657c7252fce None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.508627 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed32e9b-9081-4ff7-8011-8657c7252fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.527423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-1ed32e9b-9081-4ff7-8011-8657c7252fce None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:35.528693 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1ed32e9b-9081-4ff7-8011-8657c7252fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:35.603998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 441/894] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:35.606245 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5acdc8-87f8-4214-953b-71e67b49bcd4 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.606813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5acdc8-87f8-4214-953b-71e67b49bcd4 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.607342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5acdc8-87f8-4214-953b-71e67b49bcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.623544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b9ed5-6295-4cc5-833d-aa72195312d8 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:35.634179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5a5acdc8-87f8-4214-953b-71e67b49bcd4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:35.635445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5a5acdc8-87f8-4214-953b-71e67b49bcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:35.667681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e38ec-c44b-4522-9764-9bbef89ad942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:35.668986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e38ec-c44b-4522-9764-9bbef89ad942 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.669273 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e38ec-c44b-4522-9764-9bbef89ad942 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.669553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e38ec-c44b-4522-9764-9bbef89ad942 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.670527 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e38ec-c44b-4522-9764-9bbef89ad942 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:35.670859 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e38ec-c44b-4522-9764-9bbef89ad942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:35.672366 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e38ec-c44b-4522-9764-9bbef89ad942 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:35.681967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 454/895] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 12 14:18:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:35.682815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e38ec-c44b-4522-9764-9bbef89ad942 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:35.730537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 442/896] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:35.732713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5acdc8-87f8-4214-953b-71e67b49bcd4 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:35.810240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e38ec-c44b-4522-9764-9bbef89ad942 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:35.842587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5acdc8-87f8-4214-953b-71e67b49bcd4 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:35.852182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8b7f6-7ae0-4c1c-8faa-4ed2b20a6fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:35.852858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8b7f6-7ae0-4c1c-8faa-4ed2b20a6fdf None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.853141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8b7f6-7ae0-4c1c-8faa-4ed2b20a6fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.853411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8b7f6-7ae0-4c1c-8faa-4ed2b20a6fdf None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.854140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8b7f6-7ae0-4c1c-8faa-4ed2b20a6fdf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:35.856129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8b7f6-7ae0-4c1c-8faa-4ed2b20a6fdf None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:35.869980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 455/897] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:18:35 2022] POST /identity/v3/services => generated 241 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:35.871155 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8b7f6-7ae0-4c1c-8faa-4ed2b20a6fdf None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:35.901061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c48aa-673b-4307-87e6-2b9d1e6dd3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:35.902088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c48aa-673b-4307-87e6-2b9d1e6dd3c7 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:35.902964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c48aa-673b-4307-87e6-2b9d1e6dd3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:35.903280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314c48aa-673b-4307-87e6-2b9d1e6dd3c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:35.917987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c48aa-673b-4307-87e6-2b9d1e6dd3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:35.920724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314c48aa-673b-4307-87e6-2b9d1e6dd3c7 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-314c48aa-673b-4307-87e6-2b9d1e6dd3c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:35.945568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:35.947336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:35.949200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:35.949200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:35.949200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:35.949200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:35.949200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 443/898] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:35.953559 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c48aa-673b-4307-87e6-2b9d1e6dd3c7 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:36.010305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8b7f6-7ae0-4c1c-8faa-4ed2b20a6fdf None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:36.057690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51cc2f-f037-4bbe-8cde-db0fbf8d9276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:36.058608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51cc2f-f037-4bbe-8cde-db0fbf8d9276 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:36.058893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51cc2f-f037-4bbe-8cde-db0fbf8d9276 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:36.059207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51cc2f-f037-4bbe-8cde-db0fbf8d9276 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:36.059905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51cc2f-f037-4bbe-8cde-db0fbf8d9276 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:36.061323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af51cc2f-f037-4bbe-8cde-db0fbf8d9276 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-af51cc2f-f037-4bbe-8cde-db0fbf8d9276 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:36.075908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:36.076960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:18:36.077807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:36.082796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 456/899] 10.222.0.75 () {56 vars in 1132 bytes} [Thu May 12 14:18:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:36.084041 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51cc2f-f037-4bbe-8cde-db0fbf8d9276 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:36.103810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314c48aa-673b-4307-87e6-2b9d1e6dd3c7 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:36.156559 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd8f9-6e16-424d-be67-1991287de7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:36.158141 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd8f9-6e16-424d-be67-1991287de7ef None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:36.158634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd8f9-6e16-424d-be67-1991287de7ef None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:36.159256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fd8f9-6e16-424d-be67-1991287de7ef None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:36.160594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fd8f9-6e16-424d-be67-1991287de7ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:36.161341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fd8f9-6e16-424d-be67-1991287de7ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:36.162922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fd8f9-6e16-424d-be67-1991287de7ef None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:36.179796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 444/900] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:36.187075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd8f9-6e16-424d-be67-1991287de7ef None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:36.209469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51cc2f-f037-4bbe-8cde-db0fbf8d9276 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:36.255189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148d080-728a-45d6-acb1-4e2456197f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:36.256175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148d080-728a-45d6-acb1-4e2456197f55 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:36.256464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148d080-728a-45d6-acb1-4e2456197f55 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:36.256799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148d080-728a-45d6-acb1-4e2456197f55 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:36.257705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148d080-728a-45d6-acb1-4e2456197f55 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:36.258319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148d080-728a-45d6-acb1-4e2456197f55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:36.259761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148d080-728a-45d6-acb1-4e2456197f55 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:36.267298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 457/901] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:36.273169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148d080-728a-45d6-acb1-4e2456197f55 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:36.332528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fd8f9-6e16-424d-be67-1991287de7ef None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:36.377301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677c264-628e-4956-a5b1-33422ebf3066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:36.378238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677c264-628e-4956-a5b1-33422ebf3066 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:36.378585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677c264-628e-4956-a5b1-33422ebf3066 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:36.378928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677c264-628e-4956-a5b1-33422ebf3066 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:36.379940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148d080-728a-45d6-acb1-4e2456197f55 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:36.389844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677c264-628e-4956-a5b1-33422ebf3066 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:36.391434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677c264-628e-4956-a5b1-33422ebf3066 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-c677c264-628e-4956-a5b1-33422ebf3066 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:36.408754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:36.409767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:36.410723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:36.410723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:36.410723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:36.410723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:36.410723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:36.410723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:36.410723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:36.410723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:36.410723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:36.410723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:36.415959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 445/902] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 12 14:18:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:36.417287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677c264-628e-4956-a5b1-33422ebf3066 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:36.418834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab02ad8-39ce-476c-a978-bb3f591174da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:36.419562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab02ad8-39ce-476c-a978-bb3f591174da None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:36.419844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab02ad8-39ce-476c-a978-bb3f591174da None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:36.420121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab02ad8-39ce-476c-a978-bb3f591174da None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:36.420905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab02ad8-39ce-476c-a978-bb3f591174da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:36.421212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab02ad8-39ce-476c-a978-bb3f591174da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:36.422680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab02ad8-39ce-476c-a978-bb3f591174da None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:36.428520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 458/903] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:36.434929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab02ad8-39ce-476c-a978-bb3f591174da None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:36.538275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab02ad8-39ce-476c-a978-bb3f591174da None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:36.538588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677c264-628e-4956-a5b1-33422ebf3066 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:36.578066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290718-9fcd-46cd-8187-3639e8deaa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:36.578779 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290718-9fcd-46cd-8187-3639e8deaa0a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:36.579091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290718-9fcd-46cd-8187-3639e8deaa0a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:36.579374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290718-9fcd-46cd-8187-3639e8deaa0a None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:36.579538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f635f-59ca-4e12-a6a4-b6b852fd4959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:36.580171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f635f-59ca-4e12-a6a4-b6b852fd4959 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:36.580402 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5290718-9fcd-46cd-8187-3639e8deaa0a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:36.580563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f635f-59ca-4e12-a6a4-b6b852fd4959 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:36.580710 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f635f-59ca-4e12-a6a4-b6b852fd4959 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:36.580948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5290718-9fcd-46cd-8187-3639e8deaa0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:36.581514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f635f-59ca-4e12-a6a4-b6b852fd4959 None admin] RBAC: Adding query filter params (interface=public, service_id=2855ca8b2cfb4ad4a23b76991f523481, region_id=RegionOne) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:36.581829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f635f-59ca-4e12-a6a4-b6b852fd4959 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:36.583238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f635f-59ca-4e12-a6a4-b6b852fd4959 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:36.583707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5290718-9fcd-46cd-8187-3639e8deaa0a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:36.594051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 459/904] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 12 14:18:36 2022] GET /identity/v3/endpoints?service_id=2855ca8b2cfb4ad4a23b76991f523481&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:36.594976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f635f-59ca-4e12-a6a4-b6b852fd4959 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:36.610657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 446/905] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 12 14:18:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:36.611989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290718-9fcd-46cd-8187-3639e8deaa0a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:36.699810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f635f-59ca-4e12-a6a4-b6b852fd4959 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:36.728789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290718-9fcd-46cd-8187-3639e8deaa0a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:36.735898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31acc30-0464-4390-a907-03489e53e8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:36.736602 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acc30-0464-4390-a907-03489e53e8be None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:36.736884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acc30-0464-4390-a907-03489e53e8be None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:36.737163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31acc30-0464-4390-a907-03489e53e8be None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:36.738618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31acc30-0464-4390-a907-03489e53e8be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:36.740200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31acc30-0464-4390-a907-03489e53e8be None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:36.751299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 460/906] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 12 14:18:36 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:18:36.776362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf4d1b-552c-4058-b63d-5277c6bc7486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:36.777091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf4d1b-552c-4058-b63d-5277c6bc7486 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:36.777422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf4d1b-552c-4058-b63d-5277c6bc7486 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:36.783061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf4d1b-552c-4058-b63d-5277c6bc7486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:36.863694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf4d1b-552c-4058-b63d-5277c6bc7486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:36.865197 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf4d1b-552c-4058-b63d-5277c6bc7486 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:36.982836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 447/907] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:36 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 14:18:36.988414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31acc30-0464-4390-a907-03489e53e8be None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:37.106617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31acc30-0464-4390-a907-03489e53e8be None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:37.150532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35dd1-abcc-458d-b349-cb6f9ca336e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:37.151298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35dd1-abcc-458d-b349-cb6f9ca336e0 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:37.151581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35dd1-abcc-458d-b349-cb6f9ca336e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:37.151859 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e35dd1-abcc-458d-b349-cb6f9ca336e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:37.165403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e35dd1-abcc-458d-b349-cb6f9ca336e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:37.166877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e35dd1-abcc-458d-b349-cb6f9ca336e0 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-53e35dd1-abcc-458d-b349-cb6f9ca336e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:37.188473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:37.189445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:37.190354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:37.190354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:37.190354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:37.190354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:37.191126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 461/908] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:37.200782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf4d1b-552c-4058-b63d-5277c6bc7486 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:37.304938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf4d1b-552c-4058-b63d-5277c6bc7486 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:37.344206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f8828-7a40-4545-bb5a-1b093688e72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:37.345245 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8828-7a40-4545-bb5a-1b093688e72c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:37.345781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8828-7a40-4545-bb5a-1b093688e72c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:37.346267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8828-7a40-4545-bb5a-1b093688e72c None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:37.347303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f8828-7a40-4545-bb5a-1b093688e72c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:37.347822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f8828-7a40-4545-bb5a-1b093688e72c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:37.349417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f8828-7a40-4545-bb5a-1b093688e72c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:37.366838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 448/909] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:37.368475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35dd1-abcc-458d-b349-cb6f9ca336e0 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:37.478920 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e35dd1-abcc-458d-b349-cb6f9ca336e0 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:37.515251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd145f58-1472-4d05-a6b7-4d5a31b8ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:37.516454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd145f58-1472-4d05-a6b7-4d5a31b8ef1d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:37.516998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd145f58-1472-4d05-a6b7-4d5a31b8ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:37.517482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd145f58-1472-4d05-a6b7-4d5a31b8ef1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:37.525451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd145f58-1472-4d05-a6b7-4d5a31b8ef1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:37.527937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd145f58-1472-4d05-a6b7-4d5a31b8ef1d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-dd145f58-1472-4d05-a6b7-4d5a31b8ef1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:37.543837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:37.544828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:37.545729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:37.545729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:37.545729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:37.545729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:37.545729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:37.545729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:37.545729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:37.545729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:37.553037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 462/910] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:37.554816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f8828-7a40-4545-bb5a-1b093688e72c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:37.668919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f8828-7a40-4545-bb5a-1b093688e72c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:37.710483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad70017-a025-43a1-b03c-af4f0334f654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:37.711593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70017-a025-43a1-b03c-af4f0334f654 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:37.712111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70017-a025-43a1-b03c-af4f0334f654 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:37.712616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad70017-a025-43a1-b03c-af4f0334f654 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:37.713634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad70017-a025-43a1-b03c-af4f0334f654 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:37.714154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad70017-a025-43a1-b03c-af4f0334f654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:37.716525 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad70017-a025-43a1-b03c-af4f0334f654 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:37.737202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 449/911] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:37.738996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd145f58-1472-4d05-a6b7-4d5a31b8ef1d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:37.848815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd145f58-1472-4d05-a6b7-4d5a31b8ef1d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:37.886116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bef02-3e0b-4339-9db9-a88bef4337ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:37.887466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bef02-3e0b-4339-9db9-a88bef4337ea None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:37.887755 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bef02-3e0b-4339-9db9-a88bef4337ea None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:37.888036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bef02-3e0b-4339-9db9-a88bef4337ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:37.888931 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bef02-3e0b-4339-9db9-a88bef4337ea None admin] RBAC: Adding query filter params (role.id=e94b956e022144e290eedad9d5911aad, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=599088a56dbf4c4b9aba49fcbfce8362) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:37.889304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bef02-3e0b-4339-9db9-a88bef4337ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:37.891673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bef02-3e0b-4339-9db9-a88bef4337ea None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:37.900374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 463/912] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:37 2022] GET /identity/v3/role_assignments?user.id=599088a56dbf4c4b9aba49fcbfce8362&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=e94b956e022144e290eedad9d5911aad => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:37.957798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848dca0-544b-41dd-b2de-96bfb3166f24 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:37.958126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848dca0-544b-41dd-b2de-96bfb3166f24 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:37.958368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848dca0-544b-41dd-b2de-96bfb3166f24 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:37.960170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 450/913] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:37.967606 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324ba9b-d64b-43d8-8ac9-932f389a827d None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:37.967898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324ba9b-d64b-43d8-8ac9-932f389a827d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:37.968179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324ba9b-d64b-43d8-8ac9-932f389a827d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:37.987373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-3324ba9b-d64b-43d8-8ac9-932f389a827d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:37.988549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3324ba9b-d64b-43d8-8ac9-932f389a827d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:38.065395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 464/914] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:38.088787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848dca0-544b-41dd-b2de-96bfb3166f24 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:38.205271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848dca0-544b-41dd-b2de-96bfb3166f24 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:38.242217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4009ee0-4349-4c8f-80f7-27cb8dd5885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:38.243343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009ee0-4349-4c8f-80f7-27cb8dd5885e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:38.243826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009ee0-4349-4c8f-80f7-27cb8dd5885e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:38.244270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4009ee0-4349-4c8f-80f7-27cb8dd5885e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:38.245099 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4009ee0-4349-4c8f-80f7-27cb8dd5885e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:38.247403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4009ee0-4349-4c8f-80f7-27cb8dd5885e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-b4009ee0-4349-4c8f-80f7-27cb8dd5885e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:38.260162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:38.261222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 12 14:18:38.262258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:38.264786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 451/915] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:18:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:38.271173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324ba9b-d64b-43d8-8ac9-932f389a827d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:38.272739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35c9d4-51a1-45a9-85e9-64cca91eaec6 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:38.273506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35c9d4-51a1-45a9-85e9-64cca91eaec6 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:38.273930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35c9d4-51a1-45a9-85e9-64cca91eaec6 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:38.276782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 452/916] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:38.283869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20df72-49e6-471b-8d87-814003c27a62 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:38.284644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20df72-49e6-471b-8d87-814003c27a62 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:38.285098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20df72-49e6-471b-8d87-814003c27a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:38.309253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-af20df72-49e6-471b-8d87-814003c27a62 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:38.310736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-af20df72-49e6-471b-8d87-814003c27a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:38.376801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324ba9b-d64b-43d8-8ac9-932f389a827d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:38.407076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 453/917] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:38.420076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f373d1a-3b78-45ff-b210-1c9d939a78bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:38.421130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f373d1a-3b78-45ff-b210-1c9d939a78bd None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:38.421564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f373d1a-3b78-45ff-b210-1c9d939a78bd None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:38.422005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f373d1a-3b78-45ff-b210-1c9d939a78bd None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:38.422908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f373d1a-3b78-45ff-b210-1c9d939a78bd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:38.423550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f373d1a-3b78-45ff-b210-1c9d939a78bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:38.425017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20df72-49e6-471b-8d87-814003c27a62 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:38.425208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f373d1a-3b78-45ff-b210-1c9d939a78bd None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:38.435402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 465/918] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:18:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:38.441277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f373d1a-3b78-45ff-b210-1c9d939a78bd None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:38.530671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20df72-49e6-471b-8d87-814003c27a62 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:38.541511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f373d1a-3b78-45ff-b210-1c9d939a78bd None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:38.566542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7de2d-4bf1-47d2-911d-b0668652b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:38.567516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7de2d-4bf1-47d2-911d-b0668652b528 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:38.567646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7de2d-4bf1-47d2-911d-b0668652b528 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:38.567924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7de2d-4bf1-47d2-911d-b0668652b528 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:38.568587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7de2d-4bf1-47d2-911d-b0668652b528 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:38.569977 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7de2d-4bf1-47d2-911d-b0668652b528 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:38.579068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57ee33-1038-4264-b29f-c9935e57c9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:38.580060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57ee33-1038-4264-b29f-c9935e57c9d6 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:38.580564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57ee33-1038-4264-b29f-c9935e57c9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:38.581034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57ee33-1038-4264-b29f-c9935e57c9d6 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:38.581937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57ee33-1038-4264-b29f-c9935e57c9d6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:38.582458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57ee33-1038-4264-b29f-c9935e57c9d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-9da7de2d-4bf1-47d2-911d-b0668652b528 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:38.582562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:38.583522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:38.584358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:38.587067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57ee33-1038-4264-b29f-c9935e57c9d6 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:38.589057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 454/919] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:38.590138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7de2d-4bf1-47d2-911d-b0668652b528 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:38.593460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 466/920] 10.222.0.75 () {56 vars in 1114 bytes} [Thu May 12 14:18:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:38.599286 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57ee33-1038-4264-b29f-c9935e57c9d6 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:38.694220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7de2d-4bf1-47d2-911d-b0668652b528 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:38.702411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57ee33-1038-4264-b29f-c9935e57c9d6 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:38.729163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282c488-5d03-441b-b410-e0fbb4ec61a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:38.729842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282c488-5d03-441b-b410-e0fbb4ec61a5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:38.730126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282c488-5d03-441b-b410-e0fbb4ec61a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:38.731018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282c488-5d03-441b-b410-e0fbb4ec61a5 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:38.731778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282c488-5d03-441b-b410-e0fbb4ec61a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:38.732091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282c488-5d03-441b-b410-e0fbb4ec61a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:38.733477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282c488-5d03-441b-b410-e0fbb4ec61a5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:38.738743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 455/921] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 12 14:18:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:38.740566 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d7fcf-1eef-4d28-92a6-8273b0823d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:38.741828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d7fcf-1eef-4d28-92a6-8273b0823d33 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:38.742323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d7fcf-1eef-4d28-92a6-8273b0823d33 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:38.742795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d7fcf-1eef-4d28-92a6-8273b0823d33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:38.743824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d7fcf-1eef-4d28-92a6-8273b0823d33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:38.744935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282c488-5d03-441b-b410-e0fbb4ec61a5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:38.745885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d7fcf-1eef-4d28-92a6-8273b0823d33 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:38.775753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 467/922] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 12 14:18:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:38.874662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282c488-5d03-441b-b410-e0fbb4ec61a5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:38.923815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674769db-ccef-4d7e-bfe0-7441745dd0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:38.924945 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674769db-ccef-4d7e-bfe0-7441745dd0a9 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:38.925373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674769db-ccef-4d7e-bfe0-7441745dd0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:38.925657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674769db-ccef-4d7e-bfe0-7441745dd0a9 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:38.926400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674769db-ccef-4d7e-bfe0-7441745dd0a9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:38.926711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674769db-ccef-4d7e-bfe0-7441745dd0a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:38.928157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674769db-ccef-4d7e-bfe0-7441745dd0a9 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:38.939954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 456/923] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 12 14:18:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:38.948804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d7fcf-1eef-4d28-92a6-8273b0823d33 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:39.071909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d7fcf-1eef-4d28-92a6-8273b0823d33 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:39.114693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b3293-6223-470c-96ea-f07a866e5dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:39.115976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b3293-6223-470c-96ea-f07a866e5dab None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:39.116551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b3293-6223-470c-96ea-f07a866e5dab None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:39.117335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b3293-6223-470c-96ea-f07a866e5dab None admin] PATH_INFO: `/v3/endpoints` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:39.119188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b3293-6223-470c-96ea-f07a866e5dab None admin] RBAC: Adding query filter params (interface=public, service_id=a5680203a35345258932da59f9f39c77, region_id=RegionOne) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:39.120003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b3293-6223-470c-96ea-f07a866e5dab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:39.121887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b3293-6223-470c-96ea-f07a866e5dab None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:39.128393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 468/924] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 12 14:18:38 2022] GET /identity/v3/endpoints?service_id=a5680203a35345258932da59f9f39c77&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:39.133502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674769db-ccef-4d7e-bfe0-7441745dd0a9 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:39.246433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674769db-ccef-4d7e-bfe0-7441745dd0a9 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:39.283000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690402c9-87f2-48fe-b118-1e2e28549adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:39.284129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690402c9-87f2-48fe-b118-1e2e28549adc None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:39.284633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690402c9-87f2-48fe-b118-1e2e28549adc None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:39.285162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690402c9-87f2-48fe-b118-1e2e28549adc None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:39.286062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690402c9-87f2-48fe-b118-1e2e28549adc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:39.287743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690402c9-87f2-48fe-b118-1e2e28549adc None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:39.295503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 457/925] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 12 14:18:39 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:18:39.357931 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c91194-12ba-4e80-9bd8-c4ba1dbc2151 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:39.358266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c91194-12ba-4e80-9bd8-c4ba1dbc2151 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:39.358500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c91194-12ba-4e80-9bd8-c4ba1dbc2151 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:39.360292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 469/926] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:39.366472 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782b7a-9078-46f4-8bb4-8264ac91b99d None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:39.366811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782b7a-9078-46f4-8bb4-8264ac91b99d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:39.367014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31782b7a-9078-46f4-8bb4-8264ac91b99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:39.386057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-31782b7a-9078-46f4-8bb4-8264ac91b99d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:39.387296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-31782b7a-9078-46f4-8bb4-8264ac91b99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:39.463551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 458/927] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:39.487646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c91194-12ba-4e80-9bd8-c4ba1dbc2151 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:39.610263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c91194-12ba-4e80-9bd8-c4ba1dbc2151 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:39.644715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d17d4-fcac-43e0-829e-e600959ad673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:39.645711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d17d4-fcac-43e0-829e-e600959ad673 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:39.645989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d17d4-fcac-43e0-829e-e600959ad673 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:39.646258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d17d4-fcac-43e0-829e-e600959ad673 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:39.646972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d17d4-fcac-43e0-829e-e600959ad673 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:39.648425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d17d4-fcac-43e0-829e-e600959ad673 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-365d17d4-fcac-43e0-829e-e600959ad673 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:39.662154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:39.663218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:39.664107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 470/928] 10.222.0.75 () {56 vars in 1132 bytes} [Thu May 12 14:18:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:39.670545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31782b7a-9078-46f4-8bb4-8264ac91b99d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:39.781665 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31782b7a-9078-46f4-8bb4-8264ac91b99d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:39.817867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cff4ef-0713-42fd-ac45-5316d7be67a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:39.818904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cff4ef-0713-42fd-ac45-5316d7be67a9 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:39.819443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cff4ef-0713-42fd-ac45-5316d7be67a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:39.819936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cff4ef-0713-42fd-ac45-5316d7be67a9 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:39.820861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cff4ef-0713-42fd-ac45-5316d7be67a9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:39.821390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cff4ef-0713-42fd-ac45-5316d7be67a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:39.822976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cff4ef-0713-42fd-ac45-5316d7be67a9 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:39.829393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 459/929] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:39.839057 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d17d4-fcac-43e0-829e-e600959ad673 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:39.944765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d17d4-fcac-43e0-829e-e600959ad673 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:39.980478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57d265-fe9a-40c5-ab6e-af1834a8bfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:39.981153 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57d265-fe9a-40c5-ab6e-af1834a8bfc4 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:39.981434 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57d265-fe9a-40c5-ab6e-af1834a8bfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:39.981710 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57d265-fe9a-40c5-ab6e-af1834a8bfc4 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:39.982428 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57d265-fe9a-40c5-ab6e-af1834a8bfc4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:39.982735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57d265-fe9a-40c5-ab6e-af1834a8bfc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:39.984152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57d265-fe9a-40c5-ab6e-af1834a8bfc4 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:39.989780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 471/930] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:39.995106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cff4ef-0713-42fd-ac45-5316d7be67a9 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:40.108139 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cff4ef-0713-42fd-ac45-5316d7be67a9 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:40.146124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c7b23-5e93-446c-9ddb-79c8ec0189a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:40.147258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7b23-5e93-446c-9ddb-79c8ec0189a1 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:40.147748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7b23-5e93-446c-9ddb-79c8ec0189a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:40.148234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7b23-5e93-446c-9ddb-79c8ec0189a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:40.149189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c7b23-5e93-446c-9ddb-79c8ec0189a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:40.150755 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c7b23-5e93-446c-9ddb-79c8ec0189a1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:40.176611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 460/931] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 12 14:18:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:18:40.284107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8dd27-3eac-43de-86a0-aea9f5b2065f None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:40.284414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8dd27-3eac-43de-86a0-aea9f5b2065f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:40.284581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8dd27-3eac-43de-86a0-aea9f5b2065f None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:40.286351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 472/932] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:40.292329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337628a-1d58-4a21-8ebe-86aba63ca29a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:40.293603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337628a-1d58-4a21-8ebe-86aba63ca29a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:40.294092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337628a-1d58-4a21-8ebe-86aba63ca29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:40.314404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-6337628a-1d58-4a21-8ebe-86aba63ca29a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:40.316438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6337628a-1d58-4a21-8ebe-86aba63ca29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:40.404229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 461/933] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:40.427573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8dd27-3eac-43de-86a0-aea9f5b2065f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:40.534447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8dd27-3eac-43de-86a0-aea9f5b2065f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:40.570206 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddf047-f694-4098-af37-22ed4cd299c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:40.571106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddf047-f694-4098-af37-22ed4cd299c9 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:40.571396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddf047-f694-4098-af37-22ed4cd299c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:40.571676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddf047-f694-4098-af37-22ed4cd299c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:40.583377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daddf047-f694-4098-af37-22ed4cd299c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-daddf047-f694-4098-af37-22ed4cd299c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:40.591843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:40.592864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:40.593715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 473/934] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 12 14:18:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:40.599249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337628a-1d58-4a21-8ebe-86aba63ca29a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:40.708281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337628a-1d58-4a21-8ebe-86aba63ca29a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:40.744718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0b08c-321e-466b-acda-695cf7c75f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:40.745486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0b08c-321e-466b-acda-695cf7c75f0b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:40.745766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0b08c-321e-466b-acda-695cf7c75f0b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:40.746604 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0b08c-321e-466b-acda-695cf7c75f0b None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:40.747394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0b08c-321e-466b-acda-695cf7c75f0b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:40.747700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0b08c-321e-466b-acda-695cf7c75f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:40.749095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0b08c-321e-466b-acda-695cf7c75f0b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:40.758391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 462/935] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 12 14:18:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:40.764763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddf047-f694-4098-af37-22ed4cd299c9 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:40.868223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddf047-f694-4098-af37-22ed4cd299c9 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:40.909349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5369f-e6e8-4e21-8dbb-97111208fcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:40.910145 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5369f-e6e8-4e21-8dbb-97111208fcb5 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:40.910428 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5369f-e6e8-4e21-8dbb-97111208fcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:40.910703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5369f-e6e8-4e21-8dbb-97111208fcb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:40.922026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5369f-e6e8-4e21-8dbb-97111208fcb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:40.923588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5369f-e6e8-4e21-8dbb-97111208fcb5 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-22f5369f-e6e8-4e21-8dbb-97111208fcb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:40.941903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:40.942848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:40.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:40.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:40.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:40.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:40.943774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 474/936] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:40.949200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0b08c-321e-466b-acda-695cf7c75f0b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:41.072283 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0b08c-321e-466b-acda-695cf7c75f0b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:41.111711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3132e34-51b7-4321-adb6-dc2a300df461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:41.112392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3132e34-51b7-4321-adb6-dc2a300df461 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.112673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3132e34-51b7-4321-adb6-dc2a300df461 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.112948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3132e34-51b7-4321-adb6-dc2a300df461 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.113682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3132e34-51b7-4321-adb6-dc2a300df461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:41.113986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3132e34-51b7-4321-adb6-dc2a300df461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:41.115411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3132e34-51b7-4321-adb6-dc2a300df461 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:41.129162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 463/937] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:41.134835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5369f-e6e8-4e21-8dbb-97111208fcb5 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:41.263058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b6e25-866c-4a1d-b9a3-7a2493fb301c None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.263360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b6e25-866c-4a1d-b9a3-7a2493fb301c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.263609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b6e25-866c-4a1d-b9a3-7a2493fb301c None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.265140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 464/938] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:41.270802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e2b1c-83c3-4a76-bfa4-a512a99030b5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.271167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e2b1c-83c3-4a76-bfa4-a512a99030b5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.271454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e2b1c-83c3-4a76-bfa4-a512a99030b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.272265 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5369f-e6e8-4e21-8dbb-97111208fcb5 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:41.292422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-518e2b1c-83c3-4a76-bfa4-a512a99030b5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:41.294770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-518e2b1c-83c3-4a76-bfa4-a512a99030b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:41.312978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e774d1-f72a-4a88-968f-f3d287855c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:41.313804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e774d1-f72a-4a88-968f-f3d287855c8a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.314087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e774d1-f72a-4a88-968f-f3d287855c8a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.314363 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e774d1-f72a-4a88-968f-f3d287855c8a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.325278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e774d1-f72a-4a88-968f-f3d287855c8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:41.327017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e774d1-f72a-4a88-968f-f3d287855c8a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-55e774d1-f72a-4a88-968f-f3d287855c8a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:41.346225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:41.347337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:41.348288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 475/939] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 12 14:18:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:41.353294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e774d1-f72a-4a88-968f-f3d287855c8a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:41.377145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 465/940] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:41.407808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e2b1c-83c3-4a76-bfa4-a512a99030b5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:41.467635 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e774d1-f72a-4a88-968f-f3d287855c8a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:41.507811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786ad0-a9b4-4fde-b722-c51de2840fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:41.508493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786ad0-a9b4-4fde-b722-c51de2840fa8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.508773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786ad0-a9b4-4fde-b722-c51de2840fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.509050 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c786ad0-a9b4-4fde-b722-c51de2840fa8 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.509901 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c786ad0-a9b4-4fde-b722-c51de2840fa8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:41.510207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c786ad0-a9b4-4fde-b722-c51de2840fa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:41.512844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c786ad0-a9b4-4fde-b722-c51de2840fa8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:41.535390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 476/941] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 12 14:18:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:41.542929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e2b1c-83c3-4a76-bfa4-a512a99030b5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:41.547249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786ad0-a9b4-4fde-b722-c51de2840fa8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:41.590051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:41.592116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.592116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.592116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.592555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:41.594052 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:41.595502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WARNING keystone.server.flask.common [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 14:18:41.615071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.sql.core [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 14:18:41.615071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 14:18:41.615071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [parameters: {'id': '9210c20354ed41ae93d75d52160325c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 14:18:41.615071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79922) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9210c20354ed41ae93d75d52160325c9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9210c20354ed41ae93d75d52160325c9. May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application conn.query(q) May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:18:41.637658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application result.read() May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 12 14:18:41.638565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return project_ref.to_dict() May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application next(self.gen) May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application yield resource May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application next(self.gen) May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self.session.rollback() May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self.force_reraise() May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise self.value May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application session.commit() May 12 14:18:41.644599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._prepare_impl() May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self.session.flush() May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._flush(objects) May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application compat.raise_( May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application flush_context.execute() May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 14:18:41.645771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rec.execute(self) May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application c = connection._execute_20( May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 14:18:41.646684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application conn.query(q) May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application result.read() May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:18:41.647491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [parameters: {'id': '9210c20354ed41ae93d75d52160325c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:41.649623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:41.652309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:41.654539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:41.654539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 12 14:18:41.654539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 12 14:18:41.654539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:41.654539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:41.654539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 12 14:18:41.654539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.Conflict( May 12 14:18:41.654539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9210c20354ed41ae93d75d52160325c9. May 12 14:18:41.654539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:41.654539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 466/942] 10.222.0.75 () {60 vars in 1140 bytes} [Thu May 12 14:18:41 2022] POST /identity/v3/projects => generated 262 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:41.656566 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:41.675553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c786ad0-a9b4-4fde-b722-c51de2840fa8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:41.718850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bcd78-1b2d-4919-9be7-ae825909dd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:41.719704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bcd78-1b2d-4919-9be7-ae825909dd98 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.720074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bcd78-1b2d-4919-9be7-ae825909dd98 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.720359 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bcd78-1b2d-4919-9be7-ae825909dd98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.733895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bcd78-1b2d-4919-9be7-ae825909dd98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:41.736364 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bcd78-1b2d-4919-9be7-ae825909dd98 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-874bcd78-1b2d-4919-9be7-ae825909dd98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:41.759894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:41.761018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:41.762478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:41.762478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:41.762478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:41.762478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:41.769237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 477/943] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:41.771065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bcd78-1b2d-4919-9be7-ae825909dd98 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:41.778076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c386102-09fe-4740-ae12-8c6347b4b270 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:41.819732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487cb51a-b386-45c4-a335-e6be20b4f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:41.820529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb51a-b386-45c4-a335-e6be20b4f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.820808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb51a-b386-45c4-a335-e6be20b4f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.821077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487cb51a-b386-45c4-a335-e6be20b4f7d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.829862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cb51a-b386-45c4-a335-e6be20b4f7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:41.832001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487cb51a-b386-45c4-a335-e6be20b4f7d3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-487cb51a-b386-45c4-a335-e6be20b4f7d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:41.847931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:41.849056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:41.849978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:41.849978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:41.849978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:41.849978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:41.849978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:41.849978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:41.849978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:41.849978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:41.850417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 467/944] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:41.852301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074ec5f-5ba3-438f-bb25-2aa6100a0d63 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.852674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074ec5f-5ba3-438f-bb25-2aa6100a0d63 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.853023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074ec5f-5ba3-438f-bb25-2aa6100a0d63 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.858102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 468/945] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:41.859061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074ec5f-5ba3-438f-bb25-2aa6100a0d63 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:41.888122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bcd78-1b2d-4919-9be7-ae825909dd98 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:41.926118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7db758-d3ba-4696-ae5c-25ddf54f5efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:41.926719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7db758-d3ba-4696-ae5c-25ddf54f5efb None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.926993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7db758-d3ba-4696-ae5c-25ddf54f5efb None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.927302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7db758-d3ba-4696-ae5c-25ddf54f5efb None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.928034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7db758-d3ba-4696-ae5c-25ddf54f5efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:41.928340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7db758-d3ba-4696-ae5c-25ddf54f5efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:41.929763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7db758-d3ba-4696-ae5c-25ddf54f5efb None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:41.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 478/946] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:41.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137579-b5b2-4ff8-a9a3-2babf6620245 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:41.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137579-b5b2-4ff8-a9a3-2babf6620245 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:41.945771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f137579-b5b2-4ff8-a9a3-2babf6620245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:41.967721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-3f137579-b5b2-4ff8-a9a3-2babf6620245 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:41.968938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3f137579-b5b2-4ff8-a9a3-2babf6620245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:41.978091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074ec5f-5ba3-438f-bb25-2aa6100a0d63 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:42.016354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d20f4-bfc0-4281-b26f-b4a8448ffa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:42.017578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d20f4-bfc0-4281-b26f-b4a8448ffa35 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:42.017578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d20f4-bfc0-4281-b26f-b4a8448ffa35 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:42.017578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d20f4-bfc0-4281-b26f-b4a8448ffa35 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:42.018350 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d20f4-bfc0-4281-b26f-b4a8448ffa35 None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:42.018660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d20f4-bfc0-4281-b26f-b4a8448ffa35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:42.020412 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d20f4-bfc0-4281-b26f-b4a8448ffa35 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:42.038955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 469/947] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:42.038955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d20f4-bfc0-4281-b26f-b4a8448ffa35 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:42.063002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 479/948] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:42.085563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f137579-b5b2-4ff8-a9a3-2babf6620245 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:42.163701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d20f4-bfc0-4281-b26f-b4a8448ffa35 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:42.200660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f137579-b5b2-4ff8-a9a3-2babf6620245 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:42.202770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b945-90a8-44fc-b0c6-aa673be35c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:42.203834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b945-90a8-44fc-b0c6-aa673be35c85 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:42.204280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b945-90a8-44fc-b0c6-aa673be35c85 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:42.204703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b945-90a8-44fc-b0c6-aa673be35c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:42.212796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4b945-90a8-44fc-b0c6-aa673be35c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:42.214552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4b945-90a8-44fc-b0c6-aa673be35c85 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-39f4b945-90a8-44fc-b0c6-aa673be35c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:42.230639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:42.231836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:42.232864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:42.232864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:42.232864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:42.232864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:42.232864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:42.232864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:42.232864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:42.232864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:42.234983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 470/949] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:42.241018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b945-90a8-44fc-b0c6-aa673be35c85 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:42.245739 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd0d47-2fe8-4f95-9128-4912b6b2890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:42.246935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd0d47-2fe8-4f95-9128-4912b6b2890d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:42.247471 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd0d47-2fe8-4f95-9128-4912b6b2890d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:42.247921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd0d47-2fe8-4f95-9128-4912b6b2890d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:42.248752 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd0d47-2fe8-4f95-9128-4912b6b2890d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:42.250385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd0d47-2fe8-4f95-9128-4912b6b2890d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-f0fd0d47-2fe8-4f95-9128-4912b6b2890d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:42.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:42.272005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:42.272842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 480/950] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:42.281593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd0d47-2fe8-4f95-9128-4912b6b2890d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:42.383001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b945-90a8-44fc-b0c6-aa673be35c85 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:42.412553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd0d47-2fe8-4f95-9128-4912b6b2890d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:42.432564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624aac-67f4-41e7-96fc-d926c3193b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:42.433535 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624aac-67f4-41e7-96fc-d926c3193b5b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:42.434236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624aac-67f4-41e7-96fc-d926c3193b5b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:42.434522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27624aac-67f4-41e7-96fc-d926c3193b5b None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:42.435409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624aac-67f4-41e7-96fc-d926c3193b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:42.435727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624aac-67f4-41e7-96fc-d926c3193b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:42.437928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27624aac-67f4-41e7-96fc-d926c3193b5b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:42.454460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae765340-4a3b-4844-925a-5fbf8b1814a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:42.455267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae765340-4a3b-4844-925a-5fbf8b1814a8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:42.455689 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 471/951] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:42.458322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae765340-4a3b-4844-925a-5fbf8b1814a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:42.458714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae765340-4a3b-4844-925a-5fbf8b1814a8 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:42.459536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae765340-4a3b-4844-925a-5fbf8b1814a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:42.459850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae765340-4a3b-4844-925a-5fbf8b1814a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:42.461655 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae765340-4a3b-4844-925a-5fbf8b1814a8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:42.461960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624aac-67f4-41e7-96fc-d926c3193b5b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:42.474378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 481/952] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 12 14:18:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:42.475401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae765340-4a3b-4844-925a-5fbf8b1814a8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:42.589715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27624aac-67f4-41e7-96fc-d926c3193b5b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:42.602285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae765340-4a3b-4844-925a-5fbf8b1814a8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:42.633251 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282631c-7baf-40fd-b058-08726d6099f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:42.634161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282631c-7baf-40fd-b058-08726d6099f3 None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:42.634447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282631c-7baf-40fd-b058-08726d6099f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:42.634723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282631c-7baf-40fd-b058-08726d6099f3 None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/599088a56dbf4c4b9aba49fcbfce8362/roles/e94b956e022144e290eedad9d5911aad` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:42.638157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282631c-7baf-40fd-b058-08726d6099f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=599088a56dbf4c4b9aba49fcbfce8362, role_id=e94b956e022144e290eedad9d5911aad)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:42.638940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25269e04-9255-455a-8f19-bbec1a3e5e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:42.639671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282631c-7baf-40fd-b058-08726d6099f3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:42.639803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25269e04-9255-455a-8f19-bbec1a3e5e1a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:42.640047 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25269e04-9255-455a-8f19-bbec1a3e5e1a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:42.640320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25269e04-9255-455a-8f19-bbec1a3e5e1a None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:42.641038 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25269e04-9255-455a-8f19-bbec1a3e5e1a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:42.641340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25269e04-9255-455a-8f19-bbec1a3e5e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:42.642774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25269e04-9255-455a-8f19-bbec1a3e5e1a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:42.653947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 482/953] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 12 14:18:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:42.656234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fb476-f0a3-45b6-9115-5635147fd116 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:42.656525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fb476-f0a3-45b6-9115-5635147fd116 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:42.656801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3fb476-f0a3-45b6-9115-5635147fd116 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:42.658261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 483/954] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:42.665886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fb476-f0a3-45b6-9115-5635147fd116 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:42.669070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 472/955] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:18:42 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/599088a56dbf4c4b9aba49fcbfce8362/roles/e94b956e022144e290eedad9d5911aad => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:18:42.670880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa472f1-03c0-48d4-872d-b505f8ca7b36 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:42.671374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa472f1-03c0-48d4-872d-b505f8ca7b36 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:42.671790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa472f1-03c0-48d4-872d-b505f8ca7b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:42.697409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-eaa472f1-03c0-48d4-872d-b505f8ca7b36 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:42.700466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-eaa472f1-03c0-48d4-872d-b505f8ca7b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:42.791903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 473/956] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:42.807146 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3fb476-f0a3-45b6-9115-5635147fd116 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:42.818707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa472f1-03c0-48d4-872d-b505f8ca7b36 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:42.858908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ef774-31b9-4f4d-a8d9-1f6318f9817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:42.859948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ef774-31b9-4f4d-a8d9-1f6318f9817c None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:42.860233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ef774-31b9-4f4d-a8d9-1f6318f9817c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:42.860511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ef774-31b9-4f4d-a8d9-1f6318f9817c None admin] PATH_INFO: `/v3/endpoints` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:42.861330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ef774-31b9-4f4d-a8d9-1f6318f9817c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:42.863799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ef774-31b9-4f4d-a8d9-1f6318f9817c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:42.891100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 484/957] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 12 14:18:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:42.952344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa472f1-03c0-48d4-872d-b505f8ca7b36 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:43.007938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd4b2-de6c-4baf-adba-45716f99dd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:43.008832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd4b2-de6c-4baf-adba-45716f99dd81 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:43.009118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd4b2-de6c-4baf-adba-45716f99dd81 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:43.009390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd4b2-de6c-4baf-adba-45716f99dd81 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:43.010065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd4b2-de6c-4baf-adba-45716f99dd81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:43.012172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd4b2-de6c-4baf-adba-45716f99dd81 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-3dcfd4b2-de6c-4baf-adba-45716f99dd81 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:43.026888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:43.028370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:18:43.029236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:43.033863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 474/958] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:43.040032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ef774-31b9-4f4d-a8d9-1f6318f9817c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:43.164125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ef774-31b9-4f4d-a8d9-1f6318f9817c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:43.200997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165f947-e00e-48c2-9e0d-c22c25c79318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:43.201671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165f947-e00e-48c2-9e0d-c22c25c79318 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:43.201951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165f947-e00e-48c2-9e0d-c22c25c79318 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:43.202223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165f947-e00e-48c2-9e0d-c22c25c79318 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:43.202938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165f947-e00e-48c2-9e0d-c22c25c79318 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:43.203286 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165f947-e00e-48c2-9e0d-c22c25c79318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:43.204789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165f947-e00e-48c2-9e0d-c22c25c79318 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:43.215023 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 485/959] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:43.216776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd4b2-de6c-4baf-adba-45716f99dd81 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:43.330977 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd4b2-de6c-4baf-adba-45716f99dd81 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:43.382283 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dae1a-79ea-47fe-86a4-47064208ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:43.382965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dae1a-79ea-47fe-86a4-47064208ab2f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:43.383280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dae1a-79ea-47fe-86a4-47064208ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:43.383555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dae1a-79ea-47fe-86a4-47064208ab2f None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:43.384273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dae1a-79ea-47fe-86a4-47064208ab2f None admin] RBAC: Adding query filter params (type=compute) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:43.384577 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dae1a-79ea-47fe-86a4-47064208ab2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:43.386193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dae1a-79ea-47fe-86a4-47064208ab2f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:43.399234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 475/960] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:44.552207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55e699-b826-4894-83c7-9591cde7d15f None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:44.552738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55e699-b826-4894-83c7-9591cde7d15f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:44.552843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55e699-b826-4894-83c7-9591cde7d15f None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:44.554272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 486/961] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:44.561360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303bf76-7599-4209-be38-7a6a8aa0e8f9 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:44.562726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303bf76-7599-4209-be38-7a6a8aa0e8f9 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:44.563489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303bf76-7599-4209-be38-7a6a8aa0e8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:44.586341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-4303bf76-7599-4209-be38-7a6a8aa0e8f9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:44.587964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4303bf76-7599-4209-be38-7a6a8aa0e8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:44.666718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 476/962] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:44.696491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55e699-b826-4894-83c7-9591cde7d15f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:44.824744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55e699-b826-4894-83c7-9591cde7d15f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:44.866191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df60a23-2d36-407b-aeaf-adee6b619ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:44.866876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df60a23-2d36-407b-aeaf-adee6b619ce8 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:44.867191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df60a23-2d36-407b-aeaf-adee6b619ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:44.867472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df60a23-2d36-407b-aeaf-adee6b619ce8 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:44.868191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df60a23-2d36-407b-aeaf-adee6b619ce8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:44.869650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df60a23-2d36-407b-aeaf-adee6b619ce8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:44.871552 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: WARNING keystone.server.flask.common [None req-6df60a23-2d36-407b-aeaf-adee6b619ce8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 12 14:18:44.885538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.sql.core [None req-6df60a23-2d36-407b-aeaf-adee6b619ce8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 14:18:44.885538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 14:18:44.885538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [parameters: {'user_id': 'a94e44798af845aba22ef72cd2a0bd1e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 14:18:44.885538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79923) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-6df60a23-2d36-407b-aeaf-adee6b619ce8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application conn.query(q) May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application result.read() May 12 14:18:44.893986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:18:44.895192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application next(self.gen) May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application yield resource May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application next(self.gen) May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self.session.rollback() May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self.force_reraise() May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise self.value May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application session.commit() May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 12 14:18:44.896158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._prepare_impl() May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self.session.flush() May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._flush(objects) May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application compat.raise_( May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application flush_context.execute() May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rec.execute(self) May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 12 14:18:44.897045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application _emit_insert_statements( May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application result = connection._execute_20( May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ret = self._execute_context( May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 12 14:18:44.897921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self.dialect.do_execute( May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application result = self._query(query) May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application conn.query(q) May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application result.read() May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 12 14:18:44.898768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application packet.raise_for_error() May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a94e44798af845aba22ef72cd2a0bd1e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:44.901252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 12 14:18:44.903179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 12 14:18:44.913563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 12 14:18:44.913563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 12 14:18:44.913563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 12 14:18:44.913563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 12 14:18:44.913563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 12 14:18:44.913563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:44.913563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 487/963] 10.222.0.75 () {60 vars in 1131 bytes} [Thu May 12 14:18:44 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:44.914484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303bf76-7599-4209-be38-7a6a8aa0e8f9 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:45.007526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fe61a-a74f-4f06-81eb-e768fd99d93b None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.007889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fe61a-a74f-4f06-81eb-e768fd99d93b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.008142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fe61a-a74f-4f06-81eb-e768fd99d93b None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.017100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 488/964] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:45.022400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd9bf-3c9f-41a3-88e4-70ac4b0a2a25 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.022686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd9bf-3c9f-41a3-88e4-70ac4b0a2a25 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.022967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bd9bf-3c9f-41a3-88e4-70ac4b0a2a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.027124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303bf76-7599-4209-be38-7a6a8aa0e8f9 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:45.042039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c94bd9bf-3c9f-41a3-88e4-70ac4b0a2a25 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:45.044186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c94bd9bf-3c9f-41a3-88e4-70ac4b0a2a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:45.079507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2736915-99c9-4c8e-90ee-ad6095a19cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:45.080682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2736915-99c9-4c8e-90ee-ad6095a19cc3 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.081164 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2736915-99c9-4c8e-90ee-ad6095a19cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.081633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2736915-99c9-4c8e-90ee-ad6095a19cc3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.089816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2736915-99c9-4c8e-90ee-ad6095a19cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:45.091659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2736915-99c9-4c8e-90ee-ad6095a19cc3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-c2736915-99c9-4c8e-90ee-ad6095a19cc3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:45.108596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:45.109609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:45.110581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:45.110581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:45.110581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:45.110581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:45.110581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:45.110581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:45.110581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:45.110581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:45.110581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 12 14:18:45.110581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:45.114903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 477/965] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:18:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:45.115896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2736915-99c9-4c8e-90ee-ad6095a19cc3 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:45.125954 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 489/966] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:45.151079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bd9bf-3c9f-41a3-88e4-70ac4b0a2a25 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:45.224696 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2736915-99c9-4c8e-90ee-ad6095a19cc3 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:45.261241 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491daf2f-08fb-4aba-ac7a-f41170cb3c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:45.261958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491daf2f-08fb-4aba-ac7a-f41170cb3c81 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.262240 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491daf2f-08fb-4aba-ac7a-f41170cb3c81 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.262509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491daf2f-08fb-4aba-ac7a-f41170cb3c81 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.263357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491daf2f-08fb-4aba-ac7a-f41170cb3c81 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:45.263663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491daf2f-08fb-4aba-ac7a-f41170cb3c81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:45.265183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491daf2f-08fb-4aba-ac7a-f41170cb3c81 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:45.269132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bd9bf-3c9f-41a3-88e4-70ac4b0a2a25 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:45.307160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 478/967] 10.222.0.75 () {56 vars in 1101 bytes} [Thu May 12 14:18:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:45.312165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67342d0-fe76-4502-8fa4-a52dded7c45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:45.313429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67342d0-fe76-4502-8fa4-a52dded7c45a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.313927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67342d0-fe76-4502-8fa4-a52dded7c45a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.314430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67342d0-fe76-4502-8fa4-a52dded7c45a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.328096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67342d0-fe76-4502-8fa4-a52dded7c45a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-f67342d0-fe76-4502-8fa4-a52dded7c45a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:45.337236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:45.338227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:18:45.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:45.342917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 490/968] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 12 14:18:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:45.349338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491daf2f-08fb-4aba-ac7a-f41170cb3c81 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:45.401919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9074a58-b77d-4011-b58c-3ed23229e358 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.402280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9074a58-b77d-4011-b58c-3ed23229e358 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.402450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9074a58-b77d-4011-b58c-3ed23229e358 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.404121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 491/969] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:45.409697 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ddee8-2cd1-4132-b943-2d5f42687788 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.410003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ddee8-2cd1-4132-b943-2d5f42687788 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.410363 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ddee8-2cd1-4132-b943-2d5f42687788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.429234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-4f0ddee8-2cd1-4132-b943-2d5f42687788 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:45.430479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4f0ddee8-2cd1-4132-b943-2d5f42687788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:45.484389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491daf2f-08fb-4aba-ac7a-f41170cb3c81 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:45.519192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 492/970] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:45.535297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c954db-d90e-4379-86a2-c636628b83c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:45.535990 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c954db-d90e-4379-86a2-c636628b83c2 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.536276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c954db-d90e-4379-86a2-c636628b83c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.536553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c954db-d90e-4379-86a2-c636628b83c2 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.537324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c954db-d90e-4379-86a2-c636628b83c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:45.537635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c954db-d90e-4379-86a2-c636628b83c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:45.541320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c954db-d90e-4379-86a2-c636628b83c2 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:45.541473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ddee8-2cd1-4132-b943-2d5f42687788 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:45.551889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 479/971] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 12 14:18:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:45.557878 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c954db-d90e-4379-86a2-c636628b83c2 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:45.669881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ddee8-2cd1-4132-b943-2d5f42687788 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:45.695345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c954db-d90e-4379-86a2-c636628b83c2 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:45.705190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aedc3-9178-4bc0-8f16-13fc802b5b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:45.706063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aedc3-9178-4bc0-8f16-13fc802b5b77 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.706352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aedc3-9178-4bc0-8f16-13fc802b5b77 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.706630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1aedc3-9178-4bc0-8f16-13fc802b5b77 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.707329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1aedc3-9178-4bc0-8f16-13fc802b5b77 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:45.708924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1aedc3-9178-4bc0-8f16-13fc802b5b77 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-2e1aedc3-9178-4bc0-8f16-13fc802b5b77 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:45.727079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:45.728349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:45.729244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:45.733917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c91c-e217-4560-afcb-abb7acaacfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:45.734941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c91c-e217-4560-afcb-abb7acaacfb5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.735106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 493/972] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:45.735544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c91c-e217-4560-afcb-abb7acaacfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.735824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85c91c-e217-4560-afcb-abb7acaacfb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.736668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aedc3-9178-4bc0-8f16-13fc802b5b77 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:45.747550 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85c91c-e217-4560-afcb-abb7acaacfb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:45.749090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85c91c-e217-4560-afcb-abb7acaacfb5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-0e85c91c-e217-4560-afcb-abb7acaacfb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:45.767075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:45.768042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:45.769170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:45.769170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:45.769170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:45.769170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:45.769170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 480/973] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:45.774182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c91c-e217-4560-afcb-abb7acaacfb5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:45.841665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1aedc3-9178-4bc0-8f16-13fc802b5b77 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:45.874171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85c91c-e217-4560-afcb-abb7acaacfb5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:45.874891 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc99735-353c-454f-b9e1-5900ba34a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:45.875591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99735-353c-454f-b9e1-5900ba34a83c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.875876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99735-353c-454f-b9e1-5900ba34a83c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.876152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc99735-353c-454f-b9e1-5900ba34a83c None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.876865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc99735-353c-454f-b9e1-5900ba34a83c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:45.877170 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc99735-353c-454f-b9e1-5900ba34a83c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:45.878561 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc99735-353c-454f-b9e1-5900ba34a83c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:45.883483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 494/974] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 12 14:18:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:45.884771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd003519-1280-4213-b37a-e3e100f399ec None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.885061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd003519-1280-4213-b37a-e3e100f399ec None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.885342 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd003519-1280-4213-b37a-e3e100f399ec None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.887330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 495/975] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:45.892183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd003519-1280-4213-b37a-e3e100f399ec None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:45.909525 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a27e72-ce9c-4779-9007-282a5e07de7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:45.910196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27e72-ce9c-4779-9007-282a5e07de7c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.910475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27e72-ce9c-4779-9007-282a5e07de7c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.910749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a27e72-ce9c-4779-9007-282a5e07de7c None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.911513 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a27e72-ce9c-4779-9007-282a5e07de7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:45.911821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a27e72-ce9c-4779-9007-282a5e07de7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:45.913188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a27e72-ce9c-4779-9007-282a5e07de7c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:45.925050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 481/976] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:45.926324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ad2e-988e-43f8-94b9-0892e18c4534 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:45.926631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ad2e-988e-43f8-94b9-0892e18c4534 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:45.926886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ad2e-988e-43f8-94b9-0892e18c4534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:45.943174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-43f4ad2e-988e-43f8-94b9-0892e18c4534 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:45.944369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-43f4ad2e-988e-43f8-94b9-0892e18c4534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:45.996987 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd003519-1280-4213-b37a-e3e100f399ec None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:46.016733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 482/977] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:46.017582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4ad2e-988e-43f8-94b9-0892e18c4534 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:46.031209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32a9a9-d4a1-4fab-801e-c48fa9079110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:46.031838 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32a9a9-d4a1-4fab-801e-c48fa9079110 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:46.032134 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32a9a9-d4a1-4fab-801e-c48fa9079110 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:46.032412 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32a9a9-d4a1-4fab-801e-c48fa9079110 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:46.033151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32a9a9-d4a1-4fab-801e-c48fa9079110 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:46.033438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32a9a9-d4a1-4fab-801e-c48fa9079110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:46.034832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32a9a9-d4a1-4fab-801e-c48fa9079110 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:46.041860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 496/978] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 12 14:18:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:46.046650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32a9a9-d4a1-4fab-801e-c48fa9079110 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:46.125329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4ad2e-988e-43f8-94b9-0892e18c4534 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:46.141666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32a9a9-d4a1-4fab-801e-c48fa9079110 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:46.158916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea546f14-95ea-4ebc-9f85-4c910cdab7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:46.159829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea546f14-95ea-4ebc-9f85-4c910cdab7d1 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:46.160107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea546f14-95ea-4ebc-9f85-4c910cdab7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:46.160378 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea546f14-95ea-4ebc-9f85-4c910cdab7d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:46.168097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea546f14-95ea-4ebc-9f85-4c910cdab7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:46.169549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea546f14-95ea-4ebc-9f85-4c910cdab7d1 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:46.178701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a88fd-050e-4f37-9edf-5304bcb9e444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:46.179320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a88fd-050e-4f37-9edf-5304bcb9e444 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:46.179603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a88fd-050e-4f37-9edf-5304bcb9e444 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:46.179875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a88fd-050e-4f37-9edf-5304bcb9e444 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:46.180599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a88fd-050e-4f37-9edf-5304bcb9e444 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:46.181976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a88fd-050e-4f37-9edf-5304bcb9e444 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-ea546f14-95ea-4ebc-9f85-4c910cdab7d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:46.185551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:46.186450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 483/979] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 12 14:18:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:46.187854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea546f14-95ea-4ebc-9f85-4c910cdab7d1 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:46.207718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 497/980] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:18:46 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:46.208623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a88fd-050e-4f37-9edf-5304bcb9e444 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:46.306820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea546f14-95ea-4ebc-9f85-4c910cdab7d1 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:46.335711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a88fd-050e-4f37-9edf-5304bcb9e444 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:46.344588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e41968-67ac-48e1-a376-14bc3326cce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:46.345266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e41968-67ac-48e1-a376-14bc3326cce3 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:46.345547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e41968-67ac-48e1-a376-14bc3326cce3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:46.345824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e41968-67ac-48e1-a376-14bc3326cce3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:46.346644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e41968-67ac-48e1-a376-14bc3326cce3 None admin] RBAC: Adding query filter params (interface=admin, service_id=a5680203a35345258932da59f9f39c77, region_id=RegionOne) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:46.346959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e41968-67ac-48e1-a376-14bc3326cce3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:46.348439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e41968-67ac-48e1-a376-14bc3326cce3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:46.355813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 484/981] 10.222.0.75 () {56 vars in 1249 bytes} [Thu May 12 14:18:46 2022] GET /identity/v3/endpoints?service_id=a5680203a35345258932da59f9f39c77&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:46.361728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e41968-67ac-48e1-a376-14bc3326cce3 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:46.372542 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea57cd-3cda-4553-a1fb-a88cde4d59c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:46.373236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea57cd-3cda-4553-a1fb-a88cde4d59c9 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:46.373519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea57cd-3cda-4553-a1fb-a88cde4d59c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:46.373797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea57cd-3cda-4553-a1fb-a88cde4d59c9 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:46.374651 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea57cd-3cda-4553-a1fb-a88cde4d59c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:46.374964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea57cd-3cda-4553-a1fb-a88cde4d59c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:46.376467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea57cd-3cda-4553-a1fb-a88cde4d59c9 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:46.395528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 498/982] 10.222.0.75 () {56 vars in 1149 bytes} [Thu May 12 14:18:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:46.401847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea57cd-3cda-4553-a1fb-a88cde4d59c9 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:46.481084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e41968-67ac-48e1-a376-14bc3326cce3 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:46.516230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab905d-a7fd-4021-9a69-3f79f9507043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:46.516901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab905d-a7fd-4021-9a69-3f79f9507043 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:46.517180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab905d-a7fd-4021-9a69-3f79f9507043 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:46.517452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab905d-a7fd-4021-9a69-3f79f9507043 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:46.518138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab905d-a7fd-4021-9a69-3f79f9507043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:46.519537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea57cd-3cda-4553-a1fb-a88cde4d59c9 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:46.519645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab905d-a7fd-4021-9a69-3f79f9507043 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:46.531698 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 485/983] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 12 14:18:46 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:18:46.555733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd94ff-0a3b-4568-838d-eaf0181fb286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:46.556405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd94ff-0a3b-4568-838d-eaf0181fb286 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:46.556687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd94ff-0a3b-4568-838d-eaf0181fb286 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:46.556959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd94ff-0a3b-4568-838d-eaf0181fb286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:46.629162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd94ff-0a3b-4568-838d-eaf0181fb286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:46.630664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd94ff-0a3b-4568-838d-eaf0181fb286 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:46.735715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 499/984] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:18:46.741387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab905d-a7fd-4021-9a69-3f79f9507043 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:46.865749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab905d-a7fd-4021-9a69-3f79f9507043 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:46.899160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332411cb-eb10-4135-aa07-9d5a58420c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:46.899960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332411cb-eb10-4135-aa07-9d5a58420c7d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:46.900247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332411cb-eb10-4135-aa07-9d5a58420c7d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:46.900522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332411cb-eb10-4135-aa07-9d5a58420c7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:46.910743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332411cb-eb10-4135-aa07-9d5a58420c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:46.912232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332411cb-eb10-4135-aa07-9d5a58420c7d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-332411cb-eb10-4135-aa07-9d5a58420c7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:46.929928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:46.930970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:46.932523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:46.932523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:46.932523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:46.932523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:46.932523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 486/985] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:46.936744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd94ff-0a3b-4568-838d-eaf0181fb286 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:47.037496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd94ff-0a3b-4568-838d-eaf0181fb286 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:47.071544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85e94-b734-4cbc-809d-d79af209fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:47.072216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85e94-b734-4cbc-809d-d79af209fff9 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:47.072501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85e94-b734-4cbc-809d-d79af209fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:47.072784 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85e94-b734-4cbc-809d-d79af209fff9 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:47.073510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85e94-b734-4cbc-809d-d79af209fff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:47.073851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85e94-b734-4cbc-809d-d79af209fff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:47.075278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85e94-b734-4cbc-809d-d79af209fff9 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:47.091743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 500/986] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:47.093391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332411cb-eb10-4135-aa07-9d5a58420c7d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:47.201582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332411cb-eb10-4135-aa07-9d5a58420c7d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:47.235815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a93eb-f6eb-41cf-b0d7-88c72d4ad5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:47.236609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a93eb-f6eb-41cf-b0d7-88c72d4ad5bb None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:47.236889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a93eb-f6eb-41cf-b0d7-88c72d4ad5bb None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:47.237160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a93eb-f6eb-41cf-b0d7-88c72d4ad5bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:47.243840 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a93eb-f6eb-41cf-b0d7-88c72d4ad5bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:47.245282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a93eb-f6eb-41cf-b0d7-88c72d4ad5bb None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-b55a93eb-f6eb-41cf-b0d7-88c72d4ad5bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:47.259872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:47.260858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:47.261795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:47.261795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:47.261795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:47.261795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:47.261795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:47.261795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:47.261795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:47.261795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:47.261795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 487/987] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:47.268216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85e94-b734-4cbc-809d-d79af209fff9 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:47.376590 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85e94-b734-4cbc-809d-d79af209fff9 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:47.412875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ea5dd-7e1d-4395-bc28-1269cb5ec26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:47.413547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ea5dd-7e1d-4395-bc28-1269cb5ec26e None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:47.413830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ea5dd-7e1d-4395-bc28-1269cb5ec26e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:47.414106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ea5dd-7e1d-4395-bc28-1269cb5ec26e None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:47.414902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ea5dd-7e1d-4395-bc28-1269cb5ec26e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:47.415238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ea5dd-7e1d-4395-bc28-1269cb5ec26e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:47.416704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ea5dd-7e1d-4395-bc28-1269cb5ec26e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:47.431903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 501/988] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:47.437661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a93eb-f6eb-41cf-b0d7-88c72d4ad5bb None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:47.543280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a93eb-f6eb-41cf-b0d7-88c72d4ad5bb None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:47.577122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6645695-eda4-42a5-9be0-bfb65db0e050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:47.577783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6645695-eda4-42a5-9be0-bfb65db0e050 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:47.578067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6645695-eda4-42a5-9be0-bfb65db0e050 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:47.578344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6645695-eda4-42a5-9be0-bfb65db0e050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:47.579207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6645695-eda4-42a5-9be0-bfb65db0e050 None admin] RBAC: Adding query filter params (role.id=e94b956e022144e290eedad9d5911aad, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=599088a56dbf4c4b9aba49fcbfce8362) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:47.579522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6645695-eda4-42a5-9be0-bfb65db0e050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:47.580949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6645695-eda4-42a5-9be0-bfb65db0e050 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:47.592198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 488/989] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:47 2022] GET /identity/v3/role_assignments?user.id=599088a56dbf4c4b9aba49fcbfce8362&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=e94b956e022144e290eedad9d5911aad => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:48.514097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162eafa-d4de-4103-b198-5dca96a08d27 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:48.514632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162eafa-d4de-4103-b198-5dca96a08d27 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:48.514632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162eafa-d4de-4103-b198-5dca96a08d27 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:48.518384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 502/990] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:48.524007 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ebe0-49f5-452d-83b1-88e3ea43c3f0 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:48.524482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ebe0-49f5-452d-83b1-88e3ea43c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:48.524560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ebe0-49f5-452d-83b1-88e3ea43c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:48.544657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2443ebe0-49f5-452d-83b1-88e3ea43c3f0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:48.545863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2443ebe0-49f5-452d-83b1-88e3ea43c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:48.617636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 489/991] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:48.641168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162eafa-d4de-4103-b198-5dca96a08d27 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:48.748161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162eafa-d4de-4103-b198-5dca96a08d27 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:48.789470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a21c51-25e9-410e-8aac-cfb96c5fc16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:48.790185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a21c51-25e9-410e-8aac-cfb96c5fc16f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:48.790460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a21c51-25e9-410e-8aac-cfb96c5fc16f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:48.790729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a21c51-25e9-410e-8aac-cfb96c5fc16f None admin] PATH_INFO: `/v3/services/compute` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:48.791481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a21c51-25e9-410e-8aac-cfb96c5fc16f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:48.793431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a21c51-25e9-410e-8aac-cfb96c5fc16f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-e8a21c51-25e9-410e-8aac-cfb96c5fc16f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:48.805205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:48.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:18:48.807953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:48.811151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 503/992] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:48.813243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443ebe0-49f5-452d-83b1-88e3ea43c3f0 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:48.867080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86667af3-3028-4161-acc3-9063325636b4 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:48.867080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86667af3-3028-4161-acc3-9063325636b4 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:48.867080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86667af3-3028-4161-acc3-9063325636b4 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:48.867999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 504/993] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:48.874277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97639c-25f0-4af3-a039-5fc3a19b362d None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:48.874567 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97639c-25f0-4af3-a039-5fc3a19b362d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:48.874852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97639c-25f0-4af3-a039-5fc3a19b362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:48.892237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6b97639c-25f0-4af3-a039-5fc3a19b362d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:48.893459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6b97639c-25f0-4af3-a039-5fc3a19b362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:48.922756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443ebe0-49f5-452d-83b1-88e3ea43c3f0 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:48.957791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4f3e4-07ca-41af-9e26-bffb0dda0909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:48.958642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4f3e4-07ca-41af-9e26-bffb0dda0909 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:48.958911 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4f3e4-07ca-41af-9e26-bffb0dda0909 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:48.959740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4f3e4-07ca-41af-9e26-bffb0dda0909 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:48.960543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4f3e4-07ca-41af-9e26-bffb0dda0909 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:48.960931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4f3e4-07ca-41af-9e26-bffb0dda0909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:48.962404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4f3e4-07ca-41af-9e26-bffb0dda0909 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:48.969961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 490/994] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:48.973112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 505/995] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:48.975646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4f3e4-07ca-41af-9e26-bffb0dda0909 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:48.995173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97639c-25f0-4af3-a039-5fc3a19b362d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:49.091161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4f3e4-07ca-41af-9e26-bffb0dda0909 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:49.111670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97639c-25f0-4af3-a039-5fc3a19b362d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:49.125868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958877-d625-4345-91bf-4f3c613c6c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:49.126542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958877-d625-4345-91bf-4f3c613c6c50 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:49.126845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958877-d625-4345-91bf-4f3c613c6c50 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:49.127129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958877-d625-4345-91bf-4f3c613c6c50 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:49.127840 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92958877-d625-4345-91bf-4f3c613c6c50 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:49.128144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92958877-d625-4345-91bf-4f3c613c6c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:49.129518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92958877-d625-4345-91bf-4f3c613c6c50 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:49.134498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 491/996] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:49.140485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958877-d625-4345-91bf-4f3c613c6c50 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:49.154183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c0c64-6d13-496a-849a-99529c1596f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:49.155261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0c64-6d13-496a-849a-99529c1596f3 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:49.155817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0c64-6d13-496a-849a-99529c1596f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:49.156636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0c64-6d13-496a-849a-99529c1596f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:49.157723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c0c64-6d13-496a-849a-99529c1596f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:49.159741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c0c64-6d13-496a-849a-99529c1596f3 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-156c0c64-6d13-496a-849a-99529c1596f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:49.174631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:49.175746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:49.176594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 506/997] 10.222.0.75 () {56 vars in 1126 bytes} [Thu May 12 14:18:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:49.182157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c0c64-6d13-496a-849a-99529c1596f3 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:49.248832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958877-d625-4345-91bf-4f3c613c6c50 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:49.285876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c0c64-6d13-496a-849a-99529c1596f3 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:49.290158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbe2be-7c8d-49cd-afcd-d7902fb1074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:49.291261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbe2be-7c8d-49cd-afcd-d7902fb1074f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:49.291724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbe2be-7c8d-49cd-afcd-d7902fb1074f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:49.292206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbe2be-7c8d-49cd-afcd-d7902fb1074f None admin] PATH_INFO: `/v3/endpoints` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:49.293745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbe2be-7c8d-49cd-afcd-d7902fb1074f None admin] RBAC: Adding query filter params (interface=public, service_id=0407a5f782b24150b7e3a3622d7ecf67, region_id=RegionOne) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:49.294255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbe2be-7c8d-49cd-afcd-d7902fb1074f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:49.295869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbe2be-7c8d-49cd-afcd-d7902fb1074f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:49.301328 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 492/998] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 12 14:18:49 2022] GET /identity/v3/endpoints?service_id=0407a5f782b24150b7e3a3622d7ecf67&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:49.306560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbe2be-7c8d-49cd-afcd-d7902fb1074f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:49.322554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335a8a-e4c9-44d5-a34b-925adeac1fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:49.323346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335a8a-e4c9-44d5-a34b-925adeac1fdf None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:49.323688 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335a8a-e4c9-44d5-a34b-925adeac1fdf None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:49.326466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335a8a-e4c9-44d5-a34b-925adeac1fdf None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:49.326466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335a8a-e4c9-44d5-a34b-925adeac1fdf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:49.326466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335a8a-e4c9-44d5-a34b-925adeac1fdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:49.327580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335a8a-e4c9-44d5-a34b-925adeac1fdf None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:49.336964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 507/999] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 12 14:18:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:49.337715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335a8a-e4c9-44d5-a34b-925adeac1fdf None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:49.423300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbe2be-7c8d-49cd-afcd-d7902fb1074f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:49.438491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335a8a-e4c9-44d5-a34b-925adeac1fdf None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:49.474788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632edc0-6d38-4b6d-8fa3-91be5f106874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:49.475495 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632edc0-6d38-4b6d-8fa3-91be5f106874 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:49.475777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632edc0-6d38-4b6d-8fa3-91be5f106874 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:49.476049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632edc0-6d38-4b6d-8fa3-91be5f106874 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:49.476731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632edc0-6d38-4b6d-8fa3-91be5f106874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:49.478136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632edc0-6d38-4b6d-8fa3-91be5f106874 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:49.480989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb7617-bd70-4536-9828-5bc163b60e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:49.481864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7617-bd70-4536-9828-5bc163b60e8c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:49.482301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7617-bd70-4536-9828-5bc163b60e8c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:49.482750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7617-bd70-4536-9828-5bc163b60e8c None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:49.483698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb7617-bd70-4536-9828-5bc163b60e8c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:49.484177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb7617-bd70-4536-9828-5bc163b60e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:49.485474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 493/1000] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 12 14:18:49 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:18:49.485891 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb7617-bd70-4536-9828-5bc163b60e8c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:49.491564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 508/1001] 10.222.0.75 () {56 vars in 1122 bytes} [Thu May 12 14:18:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:49.500301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632edc0-6d38-4b6d-8fa3-91be5f106874 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:49.610154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632edc0-6d38-4b6d-8fa3-91be5f106874 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:49.647651 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ed002-bea8-4cf2-b9dc-46cc6a7d90cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:49.648333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed002-bea8-4cf2-b9dc-46cc6a7d90cc None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:49.648615 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed002-bea8-4cf2-b9dc-46cc6a7d90cc None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:49.648888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ed002-bea8-4cf2-b9dc-46cc6a7d90cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:49.649656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed002-bea8-4cf2-b9dc-46cc6a7d90cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:49.651092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ed002-bea8-4cf2-b9dc-46cc6a7d90cc None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:49.669822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 494/1002] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 12 14:18:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:49.920358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e776e46-c2ff-47cd-b8fc-a351ba73cdf1 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:49.921118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e776e46-c2ff-47cd-b8fc-a351ba73cdf1 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:49.921118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e776e46-c2ff-47cd-b8fc-a351ba73cdf1 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:49.922493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 509/1003] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:49.928000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa49b79-9b40-462b-a3d7-d94c56838b8f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:49.928293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa49b79-9b40-462b-a3d7-d94c56838b8f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:49.928575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa49b79-9b40-462b-a3d7-d94c56838b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:49.947512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-0aa49b79-9b40-462b-a3d7-d94c56838b8f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:49.948734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0aa49b79-9b40-462b-a3d7-d94c56838b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:50.035061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 495/1004] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:50.055764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e776e46-c2ff-47cd-b8fc-a351ba73cdf1 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:50.168194 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e776e46-c2ff-47cd-b8fc-a351ba73cdf1 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:50.203649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17421015-4b02-4cdf-944b-c7a82c7c8104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:50.204433 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17421015-4b02-4cdf-944b-c7a82c7c8104 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:50.204726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17421015-4b02-4cdf-944b-c7a82c7c8104 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:50.205007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17421015-4b02-4cdf-944b-c7a82c7c8104 None admin] PATH_INFO: `/v3/services/image` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:50.205730 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17421015-4b02-4cdf-944b-c7a82c7c8104 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:50.207145 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17421015-4b02-4cdf-944b-c7a82c7c8104 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-17421015-4b02-4cdf-944b-c7a82c7c8104 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:50.219604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:50.220671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:50.226473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 510/1005] 10.222.0.75 () {56 vars in 1105 bytes} [Thu May 12 14:18:50 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:50.228732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa49b79-9b40-462b-a3d7-d94c56838b8f None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:50.338845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa49b79-9b40-462b-a3d7-d94c56838b8f None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:50.385179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51ce41-422f-48df-858d-92eb58e3dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:50.385857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51ce41-422f-48df-858d-92eb58e3dba2 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:50.386771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51ce41-422f-48df-858d-92eb58e3dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:50.387138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51ce41-422f-48df-858d-92eb58e3dba2 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:50.387825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51ce41-422f-48df-858d-92eb58e3dba2 None admin] RBAC: Adding query filter params (name=image) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:50.388130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51ce41-422f-48df-858d-92eb58e3dba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:50.389515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51ce41-422f-48df-858d-92eb58e3dba2 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:50.402583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 496/1006] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:50.404294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17421015-4b02-4cdf-944b-c7a82c7c8104 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:50.509813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17421015-4b02-4cdf-944b-c7a82c7c8104 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:50.546277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d639320-0c84-4b8f-87ca-173b063c9347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:50.547115 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d639320-0c84-4b8f-87ca-173b063c9347 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:50.547406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d639320-0c84-4b8f-87ca-173b063c9347 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:50.547686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d639320-0c84-4b8f-87ca-173b063c9347 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:50.548407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d639320-0c84-4b8f-87ca-173b063c9347 None admin] RBAC: Adding query filter params (type=image) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:50.548718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d639320-0c84-4b8f-87ca-173b063c9347 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:50.550120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d639320-0c84-4b8f-87ca-173b063c9347 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:50.555256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 511/1007] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:51.770534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51cf2c-07d8-4988-a183-7a338285274f None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:51.771308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51cf2c-07d8-4988-a183-7a338285274f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:51.771308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51cf2c-07d8-4988-a183-7a338285274f None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:51.772563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 497/1008] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:51.779532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163c179-fdf9-49f6-aa40-a73459276091 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:51.780488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163c179-fdf9-49f6-aa40-a73459276091 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:51.780962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163c179-fdf9-49f6-aa40-a73459276091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:51.802885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6163c179-fdf9-49f6-aa40-a73459276091 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:51.804421 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6163c179-fdf9-49f6-aa40-a73459276091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:51.903824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 512/1009] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:51.927430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51cf2c-07d8-4988-a183-7a338285274f None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:51.960027 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c950ea-c33c-477d-b756-1f27adaf44bc None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:51.960410 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c950ea-c33c-477d-b756-1f27adaf44bc None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:51.960598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c950ea-c33c-477d-b756-1f27adaf44bc None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:51.962164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 513/1010] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:51.972910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ebdd5-5e09-4304-a040-2945a0b0dc87 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:51.973207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ebdd5-5e09-4304-a040-2945a0b0dc87 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:51.973488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ebdd5-5e09-4304-a040-2945a0b0dc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:51.990671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-294ebdd5-5e09-4304-a040-2945a0b0dc87 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:51.991886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-294ebdd5-5e09-4304-a040-2945a0b0dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:52.061623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51cf2c-07d8-4988-a183-7a338285274f None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:52.075682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 514/1011] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:52.096218 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56e687-d32d-497f-b1ad-6ddf661f7a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:52.097016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56e687-d32d-497f-b1ad-6ddf661f7a5d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:52.097294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56e687-d32d-497f-b1ad-6ddf661f7a5d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:52.097567 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56e687-d32d-497f-b1ad-6ddf661f7a5d None admin] PATH_INFO: `/v3/services/compute` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:52.098509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56e687-d32d-497f-b1ad-6ddf661f7a5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:52.098870 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ebdd5-5e09-4304-a040-2945a0b0dc87 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:52.099907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56e687-d32d-497f-b1ad-6ddf661f7a5d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-be56e687-d32d-497f-b1ad-6ddf661f7a5d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:52.113596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:52.114675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:52.115656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 498/1012] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:52.121435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56e687-d32d-497f-b1ad-6ddf661f7a5d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:52.212185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ebdd5-5e09-4304-a040-2945a0b0dc87 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:52.240999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56e687-d32d-497f-b1ad-6ddf661f7a5d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:52.258912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c46820-e3b2-41c0-849d-0cf7eff0c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:52.260037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c46820-e3b2-41c0-849d-0cf7eff0c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:52.260495 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c46820-e3b2-41c0-849d-0cf7eff0c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:52.261237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c46820-e3b2-41c0-849d-0cf7eff0c5c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:52.264188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c46820-e3b2-41c0-849d-0cf7eff0c5c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:52.265685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c46820-e3b2-41c0-849d-0cf7eff0c5c7 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:52.268006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 515/1013] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:52.273420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c46820-e3b2-41c0-849d-0cf7eff0c5c7 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:52.285684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e6bf4-8de6-4d16-ae04-77363072bde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:52.285916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e6bf4-8de6-4d16-ae04-77363072bde8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:52.286355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e6bf4-8de6-4d16-ae04-77363072bde8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:52.286642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e6bf4-8de6-4d16-ae04-77363072bde8 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:52.287395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e6bf4-8de6-4d16-ae04-77363072bde8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:52.287707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e6bf4-8de6-4d16-ae04-77363072bde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:52.289112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e6bf4-8de6-4d16-ae04-77363072bde8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:52.301388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 499/1014] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:52.302463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e6bf4-8de6-4d16-ae04-77363072bde8 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:52.386937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c46820-e3b2-41c0-849d-0cf7eff0c5c7 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:52.428761 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e6bf4-8de6-4d16-ae04-77363072bde8 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:52.433610 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629a62-b7b5-45c4-afca-b07ae8f46b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:52.434277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629a62-b7b5-45c4-afca-b07ae8f46b9b None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:52.434556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629a62-b7b5-45c4-afca-b07ae8f46b9b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:52.434828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48629a62-b7b5-45c4-afca-b07ae8f46b9b None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:52.435577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629a62-b7b5-45c4-afca-b07ae8f46b9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:52.437259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48629a62-b7b5-45c4-afca-b07ae8f46b9b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:52.466964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15cde2f-899b-490c-bbc6-3d29f4340271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:52.467951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cde2f-899b-490c-bbc6-3d29f4340271 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:52.468239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cde2f-899b-490c-bbc6-3d29f4340271 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:52.468540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15cde2f-899b-490c-bbc6-3d29f4340271 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:52.469249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cde2f-899b-490c-bbc6-3d29f4340271 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:52.469570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cde2f-899b-490c-bbc6-3d29f4340271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:52.470921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15cde2f-899b-490c-bbc6-3d29f4340271 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:52.483070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 516/1015] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:18:52 2022] POST /identity/v3/projects => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:18:52.488734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 500/1016] 10.222.0.75 () {56 vars in 1112 bytes} [Thu May 12 14:18:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:52.496790 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629a62-b7b5-45c4-afca-b07ae8f46b9b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:52.627576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48629a62-b7b5-45c4-afca-b07ae8f46b9b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:52.669809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a35f-6906-46e6-9bff-6d471e4df9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:52.670172 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a35f-6906-46e6-9bff-6d471e4df9b7 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:52.670459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a35f-6906-46e6-9bff-6d471e4df9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:52.670738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a35f-6906-46e6-9bff-6d471e4df9b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:52.671532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a35f-6906-46e6-9bff-6d471e4df9b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:52.672935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a35f-6906-46e6-9bff-6d471e4df9b7 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:52.697805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 517/1017] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 12 14:18:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:52.932042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20106b-137f-4092-b860-7bd43807e0e5 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:52.932542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20106b-137f-4092-b860-7bd43807e0e5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:52.932542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20106b-137f-4092-b860-7bd43807e0e5 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:52.934100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 501/1018] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:52.940414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651c02-3791-4ee8-8962-ff42a459c1a3 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:52.940414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651c02-3791-4ee8-8962-ff42a459c1a3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:52.940414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e651c02-3791-4ee8-8962-ff42a459c1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:52.958126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-0e651c02-3791-4ee8-8962-ff42a459c1a3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:52.960685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0e651c02-3791-4ee8-8962-ff42a459c1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:53.053504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 518/1019] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:53.076040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20106b-137f-4092-b860-7bd43807e0e5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:53.181136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20106b-137f-4092-b860-7bd43807e0e5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:53.216418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5409ec-7c10-4b48-9775-c8c48e805280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:53.217009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5409ec-7c10-4b48-9775-c8c48e805280 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:53.217292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5409ec-7c10-4b48-9775-c8c48e805280 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:53.217569 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5409ec-7c10-4b48-9775-c8c48e805280 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:53.218313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5409ec-7c10-4b48-9775-c8c48e805280 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:53.219717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5409ec-7c10-4b48-9775-c8c48e805280 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:53.243071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 502/1020] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:18:53 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:18:54.876331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948a1f-72f5-4d75-8a2e-9ca1bedac423 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:54.876890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948a1f-72f5-4d75-8a2e-9ca1bedac423 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:54.876890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16948a1f-72f5-4d75-8a2e-9ca1bedac423 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:54.878578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 519/1021] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:54.883871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b8e1-49a4-47c0-9771-ef8c91fa1e9e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:54.884363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b8e1-49a4-47c0-9771-ef8c91fa1e9e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:54.884450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b8e1-49a4-47c0-9771-ef8c91fa1e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:54.902659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-eed0b8e1-49a4-47c0-9771-ef8c91fa1e9e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:54.903882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-eed0b8e1-49a4-47c0-9771-ef8c91fa1e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:54.991609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 503/1022] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:55.015994 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948a1f-72f5-4d75-8a2e-9ca1bedac423 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:55.118527 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff4d83-af9c-42e5-a01a-fa06032bf2c8 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.118819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff4d83-af9c-42e5-a01a-fa06032bf2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.119418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff4d83-af9c-42e5-a01a-fa06032bf2c8 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.121518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 504/1023] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:55.124413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16948a1f-72f5-4d75-8a2e-9ca1bedac423 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:55.128681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c6ff-652a-463c-bbc8-d079ca6e5c94 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.128896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c6ff-652a-463c-bbc8-d079ca6e5c94 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.129409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c6ff-652a-463c-bbc8-d079ca6e5c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.149249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-da53c6ff-652a-463c-bbc8-d079ca6e5c94 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:55.150476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-da53c6ff-652a-463c-bbc8-d079ca6e5c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:55.160921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391afdd-28b5-47d3-8aac-52e323a5c73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:55.161718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391afdd-28b5-47d3-8aac-52e323a5c73d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.162003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391afdd-28b5-47d3-8aac-52e323a5c73d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.162275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391afdd-28b5-47d3-8aac-52e323a5c73d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.163488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391afdd-28b5-47d3-8aac-52e323a5c73d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:55.164945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391afdd-28b5-47d3-8aac-52e323a5c73d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:55.166906 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 520/1024] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:55.173533 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391afdd-28b5-47d3-8aac-52e323a5c73d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:55.222980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 505/1025] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:55.247400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53c6ff-652a-463c-bbc8-d079ca6e5c94 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:55.282747 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391afdd-28b5-47d3-8aac-52e323a5c73d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:55.320314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d9ec6-b251-44ad-bc19-02310999a3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:55.320999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d9ec6-b251-44ad-bc19-02310999a3d3 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.321402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d9ec6-b251-44ad-bc19-02310999a3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.321587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d9ec6-b251-44ad-bc19-02310999a3d3 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.322274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d9ec6-b251-44ad-bc19-02310999a3d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:55.324322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d9ec6-b251-44ad-bc19-02310999a3d3 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:55.355087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 521/1026] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:18:55 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:18:55.355355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53c6ff-652a-463c-bbc8-d079ca6e5c94 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:55.397892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ef0d0-00cf-46de-a8e2-4cca56a50e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:55.398630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ef0d0-00cf-46de-a8e2-4cca56a50e61 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.398930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ef0d0-00cf-46de-a8e2-4cca56a50e61 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.399231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ef0d0-00cf-46de-a8e2-4cca56a50e61 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.411459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ef0d0-00cf-46de-a8e2-4cca56a50e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-682ef0d0-00cf-46de-a8e2-4cca56a50e61 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:55.419958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:55.421210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:18:55.422170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:55.423567 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 506/1027] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 12 14:18:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:55.427447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d9ec6-b251-44ad-bc19-02310999a3d3 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:55.538951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d9ec6-b251-44ad-bc19-02310999a3d3 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:55.555092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314931-69d4-4f40-9c11-604819086a03 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.555432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314931-69d4-4f40-9c11-604819086a03 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.555660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd314931-69d4-4f40-9c11-604819086a03 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.557191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 507/1028] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:55.563354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cd7f7-4051-478f-b5b3-503423efca0f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.563644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cd7f7-4051-478f-b5b3-503423efca0f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.563923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cd7f7-4051-478f-b5b3-503423efca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.574538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63d60-e222-42cd-97bf-770c6afadfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:55.575314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63d60-e222-42cd-97bf-770c6afadfae None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.575566 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63d60-e222-42cd-97bf-770c6afadfae None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.576483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63d60-e222-42cd-97bf-770c6afadfae None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.576587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63d60-e222-42cd-97bf-770c6afadfae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:55.576894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63d60-e222-42cd-97bf-770c6afadfae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:55.579106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63d60-e222-42cd-97bf-770c6afadfae None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:55.587311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 522/1029] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 12 14:18:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:55.587993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-153cd7f7-4051-478f-b5b3-503423efca0f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:55.589476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-153cd7f7-4051-478f-b5b3-503423efca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:55.593188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63d60-e222-42cd-97bf-770c6afadfae None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:55.671892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 508/1030] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:55.698909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cd7f7-4051-478f-b5b3-503423efca0f None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:55.715297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63d60-e222-42cd-97bf-770c6afadfae None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:55.762736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd956b-af2f-4af7-b3ba-64e7e2a49eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:55.763573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd956b-af2f-4af7-b3ba-64e7e2a49eaf None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.763855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd956b-af2f-4af7-b3ba-64e7e2a49eaf None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.764184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd956b-af2f-4af7-b3ba-64e7e2a49eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.776255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd956b-af2f-4af7-b3ba-64e7e2a49eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:55.777725 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd956b-af2f-4af7-b3ba-64e7e2a49eaf None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-bddd956b-af2f-4af7-b3ba-64e7e2a49eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:55.795766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:55.796770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:55.797702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:55.797702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:55.797702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:55.797702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:55.799393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 523/1031] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:55.802564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd956b-af2f-4af7-b3ba-64e7e2a49eaf None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:55.826170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cd7f7-4051-478f-b5b3-503423efca0f None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:55.873006 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523f6de-aa50-4867-807c-689955107b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:55.873935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523f6de-aa50-4867-807c-689955107b82 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.874217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523f6de-aa50-4867-807c-689955107b82 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.874494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523f6de-aa50-4867-807c-689955107b82 None admin] PATH_INFO: `/v3/services/image` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.875330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523f6de-aa50-4867-807c-689955107b82 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:55.876760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523f6de-aa50-4867-807c-689955107b82 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-4523f6de-aa50-4867-807c-689955107b82 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:55.889140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:55.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:55.897183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 509/1032] 10.222.0.75 () {56 vars in 1105 bytes} [Thu May 12 14:18:55 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:55.898005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523f6de-aa50-4867-807c-689955107b82 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:55.913589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd956b-af2f-4af7-b3ba-64e7e2a49eaf None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:55.950015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080488d4-a4d2-4b12-b087-703b7888df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:55.950603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080488d4-a4d2-4b12-b087-703b7888df0b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:55.950889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080488d4-a4d2-4b12-b087-703b7888df0b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:55.951203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080488d4-a4d2-4b12-b087-703b7888df0b None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:55.951940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080488d4-a4d2-4b12-b087-703b7888df0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:55.952249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080488d4-a4d2-4b12-b087-703b7888df0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:55.953638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080488d4-a4d2-4b12-b087-703b7888df0b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:55.970923 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 524/1033] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:55.972024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080488d4-a4d2-4b12-b087-703b7888df0b None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:56.018169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523f6de-aa50-4867-807c-689955107b82 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:56.055618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491b68b-385a-4be6-9fa7-642000d866d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:56.056298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491b68b-385a-4be6-9fa7-642000d866d0 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:56.056580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491b68b-385a-4be6-9fa7-642000d866d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:56.056886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491b68b-385a-4be6-9fa7-642000d866d0 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:56.057644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491b68b-385a-4be6-9fa7-642000d866d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:56.058004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491b68b-385a-4be6-9fa7-642000d866d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:56.059421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491b68b-385a-4be6-9fa7-642000d866d0 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:56.064863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 510/1034] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:56.070272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491b68b-385a-4be6-9fa7-642000d866d0 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:56.075399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080488d4-a4d2-4b12-b087-703b7888df0b None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:56.109806 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266fad6-0ee4-4f2f-a742-c65926a26d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:56.110613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266fad6-0ee4-4f2f-a742-c65926a26d56 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:56.110898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266fad6-0ee4-4f2f-a742-c65926a26d56 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:56.111205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266fad6-0ee4-4f2f-a742-c65926a26d56 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:56.119185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266fad6-0ee4-4f2f-a742-c65926a26d56 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:56.120820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266fad6-0ee4-4f2f-a742-c65926a26d56 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-5266fad6-0ee4-4f2f-a742-c65926a26d56 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:18:56.138521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:56.140472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:56.143657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:56.143657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:56.143657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:18:56.143657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:18:56.143657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:18:56.143657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:18:56.143657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:18:56.143657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:18:56.143657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:18:56.143657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:56.146703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 525/1035] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 12 14:18:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:56.146703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266fad6-0ee4-4f2f-a742-c65926a26d56 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:56.179860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491b68b-385a-4be6-9fa7-642000d866d0 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:56.221234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7111219-b07e-4aed-bd30-e64eac083027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:56.221808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7111219-b07e-4aed-bd30-e64eac083027 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:56.222091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7111219-b07e-4aed-bd30-e64eac083027 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:56.222392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7111219-b07e-4aed-bd30-e64eac083027 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:56.223144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7111219-b07e-4aed-bd30-e64eac083027 None admin] RBAC: Adding query filter params (type=image) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:56.223451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7111219-b07e-4aed-bd30-e64eac083027 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:56.224847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7111219-b07e-4aed-bd30-e64eac083027 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:56.230944 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 511/1036] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:56.236593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7111219-b07e-4aed-bd30-e64eac083027 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:56.260423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266fad6-0ee4-4f2f-a742-c65926a26d56 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:56.298704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d977997-3143-432a-863d-8c5912014b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:56.299413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977997-3143-432a-863d-8c5912014b9f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:56.299698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977997-3143-432a-863d-8c5912014b9f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:56.299983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d977997-3143-432a-863d-8c5912014b9f None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:56.300839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d977997-3143-432a-863d-8c5912014b9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:56.301150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d977997-3143-432a-863d-8c5912014b9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:56.302607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d977997-3143-432a-863d-8c5912014b9f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:56.328291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 526/1037] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 12 14:18:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:56.329560 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d977997-3143-432a-863d-8c5912014b9f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:56.342650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7111219-b07e-4aed-bd30-e64eac083027 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:56.381431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a943c-2dc9-41c0-9383-3614c3268cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:56.382101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a943c-2dc9-41c0-9383-3614c3268cfe None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:56.382400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a943c-2dc9-41c0-9383-3614c3268cfe None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:56.382677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a943c-2dc9-41c0-9383-3614c3268cfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:56.383479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a943c-2dc9-41c0-9383-3614c3268cfe None admin] RBAC: Adding query filter params (interface=public, service_id=da97251803f242bab20f5e5e38d883f3, region_id=RegionOne) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:56.383792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a943c-2dc9-41c0-9383-3614c3268cfe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:56.385571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a943c-2dc9-41c0-9383-3614c3268cfe None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:56.392661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 512/1038] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 12 14:18:56 2022] GET /identity/v3/endpoints?service_id=da97251803f242bab20f5e5e38d883f3&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:56.398005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a943c-2dc9-41c0-9383-3614c3268cfe None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:56.441503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d977997-3143-432a-863d-8c5912014b9f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:56.476761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49abddf-a838-4aa4-8531-92e48a371f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:56.477336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49abddf-a838-4aa4-8531-92e48a371f14 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:56.477625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49abddf-a838-4aa4-8531-92e48a371f14 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:56.477900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49abddf-a838-4aa4-8531-92e48a371f14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:56.500444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a943c-2dc9-41c0-9383-3614c3268cfe None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:56.535129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090dd48-7963-43e1-9f98-2d40c51cc0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:56.535804 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090dd48-7963-43e1-9f98-2d40c51cc0e4 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:56.536084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090dd48-7963-43e1-9f98-2d40c51cc0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:56.536412 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090dd48-7963-43e1-9f98-2d40c51cc0e4 None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:56.537105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090dd48-7963-43e1-9f98-2d40c51cc0e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:56.538493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090dd48-7963-43e1-9f98-2d40c51cc0e4 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:56.555062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 513/1039] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 12 14:18:56 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:18:56.555275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49abddf-a838-4aa4-8531-92e48a371f14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:56.555275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49abddf-a838-4aa4-8531-92e48a371f14 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:56.671283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 527/1040] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:56 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 14:18:56.674897 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090dd48-7963-43e1-9f98-2d40c51cc0e4 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:56.785089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090dd48-7963-43e1-9f98-2d40c51cc0e4 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:56.818165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2654624-eb88-4b0b-a62c-a59b80b69a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:56.818965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2654624-eb88-4b0b-a62c-a59b80b69a6d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:56.819302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2654624-eb88-4b0b-a62c-a59b80b69a6d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:56.819560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2654624-eb88-4b0b-a62c-a59b80b69a6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:56.831270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2654624-eb88-4b0b-a62c-a59b80b69a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:56.832718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2654624-eb88-4b0b-a62c-a59b80b69a6d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-c2654624-eb88-4b0b-a62c-a59b80b69a6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:18:56.851603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:56.852583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:56.853568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:18:56.853568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:18:56.853568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:18:56.853568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:56.853568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 514/1041] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:56.860180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49abddf-a838-4aa4-8531-92e48a371f14 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:56.964615 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49abddf-a838-4aa4-8531-92e48a371f14 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:57.002528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d6781-f246-4ad9-98b6-e63125c928d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:57.003220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6781-f246-4ad9-98b6-e63125c928d8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:57.003502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6781-f246-4ad9-98b6-e63125c928d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:57.003776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d6781-f246-4ad9-98b6-e63125c928d8 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:57.004505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d6781-f246-4ad9-98b6-e63125c928d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:57.004805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d6781-f246-4ad9-98b6-e63125c928d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:57.006183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d6781-f246-4ad9-98b6-e63125c928d8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:57.023095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 528/1042] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:57.024325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2654624-eb88-4b0b-a62c-a59b80b69a6d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:57.128181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2654624-eb88-4b0b-a62c-a59b80b69a6d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:57.162607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac115c47-ad69-4e05-8a40-41e324133a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:57.163435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115c47-ad69-4e05-8a40-41e324133a74 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:57.163718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115c47-ad69-4e05-8a40-41e324133a74 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:57.163993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac115c47-ad69-4e05-8a40-41e324133a74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:57.170820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac115c47-ad69-4e05-8a40-41e324133a74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:57.172336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac115c47-ad69-4e05-8a40-41e324133a74 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-ac115c47-ad69-4e05-8a40-41e324133a74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:18:57.187407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:57.188542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:57.189479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:18:57.189479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:18:57.189479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:18:57.189479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:18:57.189479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:18:57.189479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:18:57.189479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:18:57.189479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:57.189479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 515/1043] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:57.196082 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d6781-f246-4ad9-98b6-e63125c928d8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:57.302521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d6781-f246-4ad9-98b6-e63125c928d8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:57.337855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd63ce-d0b1-4fc8-bdca-82fabc6e0c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:57.338533 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd63ce-d0b1-4fc8-bdca-82fabc6e0c39 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:57.338814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd63ce-d0b1-4fc8-bdca-82fabc6e0c39 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:57.339717 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd63ce-d0b1-4fc8-bdca-82fabc6e0c39 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:57.340568 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd63ce-d0b1-4fc8-bdca-82fabc6e0c39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:57.340876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd63ce-d0b1-4fc8-bdca-82fabc6e0c39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:57.342330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd63ce-d0b1-4fc8-bdca-82fabc6e0c39 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:57.362290 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 529/1044] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:57.363595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac115c47-ad69-4e05-8a40-41e324133a74 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:57.469997 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac115c47-ad69-4e05-8a40-41e324133a74 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:57.503985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28fac7-9638-409c-acb7-2e60a3a98dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:57.504642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28fac7-9638-409c-acb7-2e60a3a98dd0 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:57.504920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28fac7-9638-409c-acb7-2e60a3a98dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:57.505191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28fac7-9638-409c-acb7-2e60a3a98dd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:57.506018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28fac7-9638-409c-acb7-2e60a3a98dd0 None admin] RBAC: Adding query filter params (role.id=e94b956e022144e290eedad9d5911aad, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=2366609a0a564e7fbcb05b503de78580) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:57.506329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28fac7-9638-409c-acb7-2e60a3a98dd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:57.509977 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28fac7-9638-409c-acb7-2e60a3a98dd0 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:57.523064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 516/1045] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:57 2022] GET /identity/v3/role_assignments?user.id=2366609a0a564e7fbcb05b503de78580&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=e94b956e022144e290eedad9d5911aad => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:57.743350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56a047-1e25-4645-ad64-6c46b0373bcc None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:57.743600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56a047-1e25-4645-ad64-6c46b0373bcc None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:57.743841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56a047-1e25-4645-ad64-6c46b0373bcc None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:57.745976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 530/1046] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:18:57.751727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4c82f-383c-4159-bbb0-d8d1df9ab309 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:57.752020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4c82f-383c-4159-bbb0-d8d1df9ab309 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:57.752302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4c82f-383c-4159-bbb0-d8d1df9ab309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:57.769935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-21b4c82f-383c-4159-bbb0-d8d1df9ab309 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:57.771190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-21b4c82f-383c-4159-bbb0-d8d1df9ab309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:57.842071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 517/1047] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:57.865842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56a047-1e25-4645-ad64-6c46b0373bcc None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:57.977763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56a047-1e25-4645-ad64-6c46b0373bcc None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:58.012585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b163f-12c5-4f55-b0c8-c0b9873e802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:58.013303 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b163f-12c5-4f55-b0c8-c0b9873e802f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:58.013594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b163f-12c5-4f55-b0c8-c0b9873e802f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:58.013872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b163f-12c5-4f55-b0c8-c0b9873e802f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:58.028255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b163f-12c5-4f55-b0c8-c0b9873e802f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-be4b163f-12c5-4f55-b0c8-c0b9873e802f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:18:58.036211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:58.037181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:18:58.038026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:18:58.039299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 531/1048] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:18:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:18:58.044071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4c82f-383c-4159-bbb0-d8d1df9ab309 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:58.145882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4c82f-383c-4159-bbb0-d8d1df9ab309 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:58.180706 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c27af-a185-4d54-b9ee-584d1676c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:58.181379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c27af-a185-4d54-b9ee-584d1676c4ce None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:58.181657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c27af-a185-4d54-b9ee-584d1676c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:58.181925 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c27af-a185-4d54-b9ee-584d1676c4ce None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:58.183217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c27af-a185-4d54-b9ee-584d1676c4ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:58.183526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c27af-a185-4d54-b9ee-584d1676c4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:58.184891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c27af-a185-4d54-b9ee-584d1676c4ce None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:58.198325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 518/1049] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:58.200263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b163f-12c5-4f55-b0c8-c0b9873e802f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:58.319722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b163f-12c5-4f55-b0c8-c0b9873e802f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:58.361514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16b8d-9218-4894-a971-df6c7129dc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:58.362405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16b8d-9218-4894-a971-df6c7129dc89 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:58.362689 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16b8d-9218-4894-a971-df6c7129dc89 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:58.362965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16b8d-9218-4894-a971-df6c7129dc89 None admin] PATH_INFO: `/v3/users/a2d4b029b944408ea7943483192a4d32` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:58.381444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c16b8d-9218-4894-a971-df6c7129dc89 None admin] RBAC: Authorizing `identity:get_user(user_id=a2d4b029b944408ea7943483192a4d32)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:58.382894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c16b8d-9218-4894-a971-df6c7129dc89 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:58.387545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 532/1050] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:18:58 2022] GET /identity/v3/users/a2d4b029b944408ea7943483192a4d32 => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:58.392904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c27af-a185-4d54-b9ee-584d1676c4ce None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:58.507438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c27af-a185-4d54-b9ee-584d1676c4ce None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:58.544014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b5c93-44fb-41ce-979c-8b43f2e27723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:58.545028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b5c93-44fb-41ce-979c-8b43f2e27723 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:58.545548 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b5c93-44fb-41ce-979c-8b43f2e27723 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:58.546025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b5c93-44fb-41ce-979c-8b43f2e27723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:58.615709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b5c93-44fb-41ce-979c-8b43f2e27723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:58.617510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b5c93-44fb-41ce-979c-8b43f2e27723 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:58.737798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 519/1051] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:18:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:18:58.739101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16b8d-9218-4894-a971-df6c7129dc89 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:58.829866 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aa3f-a4e9-4c79-8417-095140f72ed0 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:58.830237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aa3f-a4e9-4c79-8417-095140f72ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:58.830435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aa3f-a4e9-4c79-8417-095140f72ed0 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:58.831991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 520/1052] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:58.837101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a480cab-ea3a-4c30-a1da-7c0758d83d4e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:58.837389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a480cab-ea3a-4c30-a1da-7c0758d83d4e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:58.837666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a480cab-ea3a-4c30-a1da-7c0758d83d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:58.851718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16b8d-9218-4894-a971-df6c7129dc89 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:58.855405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-9a480cab-ea3a-4c30-a1da-7c0758d83d4e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:58.856885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9a480cab-ea3a-4c30-a1da-7c0758d83d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:58.888257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992a31b-728f-4c1c-80a7-ab4b96a1c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:58.889045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992a31b-728f-4c1c-80a7-ab4b96a1c31f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:58.889322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992a31b-728f-4c1c-80a7-ab4b96a1c31f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:58.889597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992a31b-728f-4c1c-80a7-ab4b96a1c31f None admin] PATH_INFO: `/v3/projects/ade4de1f43a249469fcdba6e9bee22de` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:58.890828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992a31b-728f-4c1c-80a7-ab4b96a1c31f None admin] RBAC: Authorizing `identity:get_project(project_id=ade4de1f43a249469fcdba6e9bee22de)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:58.892320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992a31b-728f-4c1c-80a7-ab4b96a1c31f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:58.894046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 533/1053] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:18:58 2022] GET /identity/v3/projects/ade4de1f43a249469fcdba6e9bee22de => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:58.900397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992a31b-728f-4c1c-80a7-ab4b96a1c31f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:58.930366 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 521/1054] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:18:58.954332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a480cab-ea3a-4c30-a1da-7c0758d83d4e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:59.038046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992a31b-728f-4c1c-80a7-ab4b96a1c31f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:59.075208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55771e18-f9fa-4280-aedf-51ab9c84bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:59.076693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771e18-f9fa-4280-aedf-51ab9c84bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:59.077546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771e18-f9fa-4280-aedf-51ab9c84bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:59.078029 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771e18-f9fa-4280-aedf-51ab9c84bfd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:59.079096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55771e18-f9fa-4280-aedf-51ab9c84bfd4 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=ade4de1f43a249469fcdba6e9bee22de, user.id=a2d4b029b944408ea7943483192a4d32) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:59.079221 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a480cab-ea3a-4c30-a1da-7c0758d83d4e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:59.080092 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55771e18-f9fa-4280-aedf-51ab9c84bfd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:59.082811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55771e18-f9fa-4280-aedf-51ab9c84bfd4 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:59.090381 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 534/1055] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:18:58 2022] GET /identity/v3/role_assignments?user.id=a2d4b029b944408ea7943483192a4d32&scope.project.id=ade4de1f43a249469fcdba6e9bee22de&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:18:59.120021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d4fa-9579-4b54-b49c-9e7ca04d30a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:59.120879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d4fa-9579-4b54-b49c-9e7ca04d30a2 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:59.121161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d4fa-9579-4b54-b49c-9e7ca04d30a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:59.121429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98d4fa-9579-4b54-b49c-9e7ca04d30a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:59.122103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d4fa-9579-4b54-b49c-9e7ca04d30a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:59.123651 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98d4fa-9579-4b54-b49c-9e7ca04d30a2 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-2a98d4fa-9579-4b54-b49c-9e7ca04d30a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:18:59.136594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:18:59.137691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:18:59.138588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 522/1056] 10.222.0.75 () {56 vars in 1105 bytes} [Thu May 12 14:18:58 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:18:59.145025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55771e18-f9fa-4280-aedf-51ab9c84bfd4 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:59.270732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55771e18-f9fa-4280-aedf-51ab9c84bfd4 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:59.312158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9eacb-57a2-443c-9c52-421b24c3c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:59.312429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9eacb-57a2-443c-9c52-421b24c3c553 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:59.312931 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9eacb-57a2-443c-9c52-421b24c3c553 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:59.313440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9eacb-57a2-443c-9c52-421b24c3c553 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:59.314811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9eacb-57a2-443c-9c52-421b24c3c553 None admin] RBAC: Adding query filter params (name=image) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:59.315401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9eacb-57a2-443c-9c52-421b24c3c553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:59.317991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9eacb-57a2-443c-9c52-421b24c3c553 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:59.325477 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 535/1057] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:59.331441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d4fa-9579-4b54-b49c-9e7ca04d30a2 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:59.439560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98d4fa-9579-4b54-b49c-9e7ca04d30a2 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:59.486120 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a488f-a102-4ac4-9ef7-799698a429ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:59.487250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a488f-a102-4ac4-9ef7-799698a429ed None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:59.487720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a488f-a102-4ac4-9ef7-799698a429ed None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:59.488164 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a488f-a102-4ac4-9ef7-799698a429ed None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:59.489395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a488f-a102-4ac4-9ef7-799698a429ed None admin] RBAC: Adding query filter params (type=image) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:18:59.489918 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a488f-a102-4ac4-9ef7-799698a429ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:59.492452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a488f-a102-4ac4-9ef7-799698a429ed None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:59.505716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 523/1058] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:18:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:18:59.506990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9eacb-57a2-443c-9c52-421b24c3c553 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:18:59.616575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9eacb-57a2-443c-9c52-421b24c3c553 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:18:59.656912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb15bb-dd22-4cca-96ab-63e5d7969a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:18:59.657629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb15bb-dd22-4cca-96ab-63e5d7969a06 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:59.657913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb15bb-dd22-4cca-96ab-63e5d7969a06 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:59.658188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb15bb-dd22-4cca-96ab-63e5d7969a06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:59.658958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb15bb-dd22-4cca-96ab-63e5d7969a06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:18:59.660395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb15bb-dd22-4cca-96ab-63e5d7969a06 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:18:59.687081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 536/1059] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 12 14:18:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:18:59.815058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c99d8-d65e-4c69-a999-c6461896c446 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:59.815265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c99d8-d65e-4c69-a999-c6461896c446 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:59.815544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c99d8-d65e-4c69-a999-c6461896c446 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:59.817163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 524/1060] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:18:59.822951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd098d-6d84-4ef8-b61e-32f160e69be5 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:18:59.823368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd098d-6d84-4ef8-b61e-32f160e69be5 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:18:59.823574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd098d-6d84-4ef8-b61e-32f160e69be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:18:59.841951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-5ebd098d-6d84-4ef8-b61e-32f160e69be5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:18:59.843226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5ebd098d-6d84-4ef8-b61e-32f160e69be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:18:59.925168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 537/1061] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:18:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:18:59.948107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c99d8-d65e-4c69-a999-c6461896c446 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:00.058733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c99d8-d65e-4c69-a999-c6461896c446 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:00.096961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c3072-52c6-4c97-8f44-4ea079b38b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:00.097783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c3072-52c6-4c97-8f44-4ea079b38b70 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:00.098063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c3072-52c6-4c97-8f44-4ea079b38b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:00.098341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c3072-52c6-4c97-8f44-4ea079b38b70 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:00.109533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c3072-52c6-4c97-8f44-4ea079b38b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-ef9c3072-52c6-4c97-8f44-4ea079b38b70 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:19:00.117798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:00.118772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:19:00.119771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 525/1062] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 12 14:18:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:00.127331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd098d-6d84-4ef8-b61e-32f160e69be5 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:00.238591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd098d-6d84-4ef8-b61e-32f160e69be5 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:00.278773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc4648-c8c7-4a3d-a6cc-4aad796ccf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:00.279488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc4648-c8c7-4a3d-a6cc-4aad796ccf9e None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:00.279774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc4648-c8c7-4a3d-a6cc-4aad796ccf9e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:00.280058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc4648-c8c7-4a3d-a6cc-4aad796ccf9e None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:00.280821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc4648-c8c7-4a3d-a6cc-4aad796ccf9e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:00.281133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc4648-c8c7-4a3d-a6cc-4aad796ccf9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:00.282532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc4648-c8c7-4a3d-a6cc-4aad796ccf9e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:00.296346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 538/1063] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 12 14:19:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:00.297809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c3072-52c6-4c97-8f44-4ea079b38b70 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:00.438919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c3072-52c6-4c97-8f44-4ea079b38b70 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:00.495541 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32355ce2-67cd-4c1b-b40f-fb614d4a9f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:00.496349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32355ce2-67cd-4c1b-b40f-fb614d4a9f4c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:00.496631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32355ce2-67cd-4c1b-b40f-fb614d4a9f4c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:00.496959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32355ce2-67cd-4c1b-b40f-fb614d4a9f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:00.508302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32355ce2-67cd-4c1b-b40f-fb614d4a9f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:00.509758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32355ce2-67cd-4c1b-b40f-fb614d4a9f4c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-32355ce2-67cd-4c1b-b40f-fb614d4a9f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:19:00.527987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:00.529756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:00.531572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:19:00.531572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:19:00.531572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:19:00.531572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:19:00.531572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 526/1064] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:00.537766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc4648-c8c7-4a3d-a6cc-4aad796ccf9e None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:00.649984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc4648-c8c7-4a3d-a6cc-4aad796ccf9e None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:00.692584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab54636-166c-47d7-a446-34f25c2b8cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:00.693178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54636-166c-47d7-a446-34f25c2b8cc7 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:00.693462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54636-166c-47d7-a446-34f25c2b8cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:00.693738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54636-166c-47d7-a446-34f25c2b8cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:00.694473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab54636-166c-47d7-a446-34f25c2b8cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:00.694777 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab54636-166c-47d7-a446-34f25c2b8cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:00.696218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab54636-166c-47d7-a446-34f25c2b8cc7 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:00.708534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 539/1065] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:00.714439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32355ce2-67cd-4c1b-b40f-fb614d4a9f4c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:00.817634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32355ce2-67cd-4c1b-b40f-fb614d4a9f4c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:00.854230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cdd19-529b-49ec-85c3-c2ffc2326053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:00.855083 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cdd19-529b-49ec-85c3-c2ffc2326053 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:00.855370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cdd19-529b-49ec-85c3-c2ffc2326053 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:00.855652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cdd19-529b-49ec-85c3-c2ffc2326053 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:00.863474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cdd19-529b-49ec-85c3-c2ffc2326053 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:00.864917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cdd19-529b-49ec-85c3-c2ffc2326053 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-e44cdd19-529b-49ec-85c3-c2ffc2326053 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:19:00.879835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:00.880938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:00.881912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:00.881912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:00.881912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:19:00.881912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:19:00.881912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:19:00.881912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:19:00.881912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:19:00.881912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:19:00.881912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:19:00.881912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:19:00.883223 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 527/1066] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 12 14:19:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:00.895071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab54636-166c-47d7-a446-34f25c2b8cc7 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:01.002059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab54636-166c-47d7-a446-34f25c2b8cc7 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:01.039576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbf770-85e4-42d1-a844-1a4121b21844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:01.040251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbf770-85e4-42d1-a844-1a4121b21844 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.040535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbf770-85e4-42d1-a844-1a4121b21844 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.040814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbf770-85e4-42d1-a844-1a4121b21844 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.041647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbf770-85e4-42d1-a844-1a4121b21844 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:01.041982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbf770-85e4-42d1-a844-1a4121b21844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:01.043473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbf770-85e4-42d1-a844-1a4121b21844 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:01.065734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 540/1067] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 12 14:19:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:01.066922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cdd19-529b-49ec-85c3-c2ffc2326053 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:01.173153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cdd19-529b-49ec-85c3-c2ffc2326053 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:01.207707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dfff7-b49c-4aac-83f0-3645d7b7a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:01.208526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dfff7-b49c-4aac-83f0-3645d7b7a790 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.208808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dfff7-b49c-4aac-83f0-3645d7b7a790 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.209079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dfff7-b49c-4aac-83f0-3645d7b7a790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.219624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dfff7-b49c-4aac-83f0-3645d7b7a790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:01.220993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dfff7-b49c-4aac-83f0-3645d7b7a790 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-8f9dfff7-b49c-4aac-83f0-3645d7b7a790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:19:01.237633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:01.238620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:01.239601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:19:01.239601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:19:01.239601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:19:01.239601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:19:01.239601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 528/1068] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:01.246447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbf770-85e4-42d1-a844-1a4121b21844 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:01.350219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbf770-85e4-42d1-a844-1a4121b21844 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:01.385985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729c562-cd8c-4ec2-8d87-344630f1f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:01.386663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729c562-cd8c-4ec2-8d87-344630f1f814 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.386947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729c562-cd8c-4ec2-8d87-344630f1f814 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.387244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729c562-cd8c-4ec2-8d87-344630f1f814 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.387984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729c562-cd8c-4ec2-8d87-344630f1f814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:01.388291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729c562-cd8c-4ec2-8d87-344630f1f814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:01.389681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729c562-cd8c-4ec2-8d87-344630f1f814 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:01.406918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 541/1069] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:01.408493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dfff7-b49c-4aac-83f0-3645d7b7a790 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:01.439949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2e8c-52b7-486e-ad35-8504a1cf9172 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.440270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2e8c-52b7-486e-ad35-8504a1cf9172 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.440523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e2e8c-52b7-486e-ad35-8504a1cf9172 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.442034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 542/1070] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:19:01.446948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd26b66-4c68-4ca9-99c6-2f868e830dc9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.447288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd26b66-4c68-4ca9-99c6-2f868e830dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.447573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd26b66-4c68-4ca9-99c6-2f868e830dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.464849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-0bd26b66-4c68-4ca9-99c6-2f868e830dc9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:01.466168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0bd26b66-4c68-4ca9-99c6-2f868e830dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:01.522347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dfff7-b49c-4aac-83f0-3645d7b7a790 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:01.549122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 543/1071] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:19:01.558492 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf1301-d114-499d-accc-c71761f6074e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:01.559622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf1301-d114-499d-accc-c71761f6074e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.560077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf1301-d114-499d-accc-c71761f6074e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.560514 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf1301-d114-499d-accc-c71761f6074e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.568144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf1301-d114-499d-accc-c71761f6074e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:01.569626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf1301-d114-499d-accc-c71761f6074e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:01.571400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd26b66-4c68-4ca9-99c6-2f868e830dc9 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-abbf1301-d114-499d-accc-c71761f6074e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:19:01.585497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:01.586663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:01.587616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:19:01.587616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:19:01.587616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:19:01.587616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:19:01.587616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:19:01.587616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:19:01.587616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:19:01.587616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:19:01.587616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 529/1072] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:19:01.593673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf1301-d114-499d-accc-c71761f6074e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:01.676990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd26b66-4c68-4ca9-99c6-2f868e830dc9 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:01.696199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf1301-d114-499d-accc-c71761f6074e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:01.712003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed007772-a7b0-49d0-912a-b7ca1df138b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:01.712800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed007772-a7b0-49d0-912a-b7ca1df138b1 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.713089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed007772-a7b0-49d0-912a-b7ca1df138b1 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.713366 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed007772-a7b0-49d0-912a-b7ca1df138b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.725886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed007772-a7b0-49d0-912a-b7ca1df138b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:19:01.732278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1e13d-b674-4989-ac59-d9706253a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:01.732945 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e13d-b674-4989-ac59-d9706253a143 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.733229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e13d-b674-4989-ac59-d9706253a143 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.733507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1e13d-b674-4989-ac59-d9706253a143 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-ed007772-a7b0-49d0-912a-b7ca1df138b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:19:01.735598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:01.736543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:01.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:01.738072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1e13d-b674-4989-ac59-d9706253a143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:01.738072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1e13d-b674-4989-ac59-d9706253a143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:01.738215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 544/1073] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:19:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:19:01.739763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1e13d-b674-4989-ac59-d9706253a143 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:01.741356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed007772-a7b0-49d0-912a-b7ca1df138b1 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:01.758039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 530/1074] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:19:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:19:01.759530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1e13d-b674-4989-ac59-d9706253a143 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:01.865405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1e13d-b674-4989-ac59-d9706253a143 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:01.865650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed007772-a7b0-49d0-912a-b7ca1df138b1 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:01.901021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a54b4-717f-4457-9979-7084901aea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:01.902463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a54b4-717f-4457-9979-7084901aea1f None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.902748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a54b4-717f-4457-9979-7084901aea1f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.903023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a54b4-717f-4457-9979-7084901aea1f None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/2366609a0a564e7fbcb05b503de78580/roles/e94b956e022144e290eedad9d5911aad` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.905343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a54b4-717f-4457-9979-7084901aea1f None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=2366609a0a564e7fbcb05b503de78580, role_id=e94b956e022144e290eedad9d5911aad)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:01.905996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561aa0f-a26d-419f-a494-f5fe1293b857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:01.906781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a54b4-717f-4457-9979-7084901aea1f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:01.907082 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561aa0f-a26d-419f-a494-f5fe1293b857 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.907559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561aa0f-a26d-419f-a494-f5fe1293b857 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.908272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561aa0f-a26d-419f-a494-f5fe1293b857 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.909871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561aa0f-a26d-419f-a494-f5fe1293b857 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:01.910411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561aa0f-a26d-419f-a494-f5fe1293b857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:01.912523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561aa0f-a26d-419f-a494-f5fe1293b857 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:01.931229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 531/1075] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:19:01 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/2366609a0a564e7fbcb05b503de78580/roles/e94b956e022144e290eedad9d5911aad => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:19:01.931427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 545/1076] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:19:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:19:01.931509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a54b4-717f-4457-9979-7084901aea1f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:01.965272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf72a6-317c-420e-a22b-3a45610d1de7 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.965557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf72a6-317c-420e-a22b-3a45610d1de7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.965722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf72a6-317c-420e-a22b-3a45610d1de7 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.967367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 546/1077] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:01.973298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62a30-224f-428e-b498-f0bb1a03b5a3 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:01.973637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62a30-224f-428e-b498-f0bb1a03b5a3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:01.973858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c62a30-224f-428e-b498-f0bb1a03b5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:01.992312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e9c62a30-224f-428e-b498-f0bb1a03b5a3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:01.993556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e9c62a30-224f-428e-b498-f0bb1a03b5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:02.061763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a54b4-717f-4457-9979-7084901aea1f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:02.087464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 547/1078] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:19:02.100301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e80bd-b47e-4545-ab7a-90a70a022f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:02.101222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e80bd-b47e-4545-ab7a-90a70a022f7c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:02.101504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e80bd-b47e-4545-ab7a-90a70a022f7c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:02.101802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e80bd-b47e-4545-ab7a-90a70a022f7c None admin] PATH_INFO: `/v3/users/a2d4b029b944408ea7943483192a4d32` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:02.103089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e80bd-b47e-4545-ab7a-90a70a022f7c None admin] RBAC: Authorizing `identity:get_user(user_id=a2d4b029b944408ea7943483192a4d32)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:02.105165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e80bd-b47e-4545-ab7a-90a70a022f7c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:02.105366 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c62a30-224f-428e-b498-f0bb1a03b5a3 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:02.107084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 532/1079] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:01 2022] GET /identity/v3/users/a2d4b029b944408ea7943483192a4d32 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:02.112744 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e80bd-b47e-4545-ab7a-90a70a022f7c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:02.208259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c62a30-224f-428e-b498-f0bb1a03b5a3 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:02.221193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e80bd-b47e-4545-ab7a-90a70a022f7c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:02.244898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a0c00-4eea-4ff7-a24f-229aa14281c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:02.246128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0c00-4eea-4ff7-a24f-229aa14281c5 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:02.246407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0c00-4eea-4ff7-a24f-229aa14281c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:02.246861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0c00-4eea-4ff7-a24f-229aa14281c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:02.258487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78006039-f498-4a61-91d4-721cf8277fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:02.259477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78006039-f498-4a61-91d4-721cf8277fd8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:02.259677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78006039-f498-4a61-91d4-721cf8277fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:02.259947 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78006039-f498-4a61-91d4-721cf8277fd8 None admin] PATH_INFO: `/v3/projects/ade4de1f43a249469fcdba6e9bee22de` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:02.261290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78006039-f498-4a61-91d4-721cf8277fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=ade4de1f43a249469fcdba6e9bee22de)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:02.262740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78006039-f498-4a61-91d4-721cf8277fd8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:02.269215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 533/1080] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:02 2022] GET /identity/v3/projects/ade4de1f43a249469fcdba6e9bee22de => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:19:02.270481 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78006039-f498-4a61-91d4-721cf8277fd8 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:02.324692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a0c00-4eea-4ff7-a24f-229aa14281c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:02.326571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a0c00-4eea-4ff7-a24f-229aa14281c5 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:02.390286 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78006039-f498-4a61-91d4-721cf8277fd8 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:02.425293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e475e-6bf8-4af4-bdca-6249aaf82cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:02.426196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e475e-6bf8-4af4-bdca-6249aaf82cce None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:02.426540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e475e-6bf8-4af4-bdca-6249aaf82cce None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:02.426821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e475e-6bf8-4af4-bdca-6249aaf82cce None admin] PATH_INFO: `/v3/projects/ade4de1f43a249469fcdba6e9bee22de/users/a2d4b029b944408ea7943483192a4d32/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:02.428893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e475e-6bf8-4af4-bdca-6249aaf82cce None admin] RBAC: Authorizing `identity:create_grant(project_id=ade4de1f43a249469fcdba6e9bee22de, user_id=a2d4b029b944408ea7943483192a4d32, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:02.430337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e475e-6bf8-4af4-bdca-6249aaf82cce None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:02.445552 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 548/1081] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:19:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 14:19:02.447911 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 534/1082] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:19:02 2022] PUT /identity/v3/projects/ade4de1f43a249469fcdba6e9bee22de/users/a2d4b029b944408ea7943483192a4d32/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:19:02.452227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a0c00-4eea-4ff7-a24f-229aa14281c5 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:02.567983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a0c00-4eea-4ff7-a24f-229aa14281c5 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:02.605443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18508d85-fe88-4cb3-80f0-6b4f55842d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:02.606259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508d85-fe88-4cb3-80f0-6b4f55842d68 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:02.606597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508d85-fe88-4cb3-80f0-6b4f55842d68 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:02.606868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18508d85-fe88-4cb3-80f0-6b4f55842d68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:02.620915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18508d85-fe88-4cb3-80f0-6b4f55842d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:02.620915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18508d85-fe88-4cb3-80f0-6b4f55842d68 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-18508d85-fe88-4cb3-80f0-6b4f55842d68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:19:02.645261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:02.646261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:02.647214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:19:02.647214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:19:02.647214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:19:02.647214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:02.647214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 549/1083] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:02.653082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e475e-6bf8-4af4-bdca-6249aaf82cce None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:02.757244 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e475e-6bf8-4af4-bdca-6249aaf82cce None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:02.793944 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97443133-7b4c-4662-8b12-ca93eee11102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:02.794619 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443133-7b4c-4662-8b12-ca93eee11102 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:02.794896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443133-7b4c-4662-8b12-ca93eee11102 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:02.795199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443133-7b4c-4662-8b12-ca93eee11102 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:02.795932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97443133-7b4c-4662-8b12-ca93eee11102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:02.796235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97443133-7b4c-4662-8b12-ca93eee11102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:02.797675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97443133-7b4c-4662-8b12-ca93eee11102 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:02.810741 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 535/1084] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:04.235130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3636-fb89-4ded-a1f7-15f39d42cbbf None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:04.235665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3636-fb89-4ded-a1f7-15f39d42cbbf None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:04.235665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e3636-fb89-4ded-a1f7-15f39d42cbbf None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:04.237053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 550/1085] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:04.242748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d60b2-52f5-41be-b801-ca86099aef9b None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:04.243274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d60b2-52f5-41be-b801-ca86099aef9b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:04.243497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d60b2-52f5-41be-b801-ca86099aef9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:04.261778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-642d60b2-52f5-41be-b801-ca86099aef9b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:04.262987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-642d60b2-52f5-41be-b801-ca86099aef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:04.335303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 536/1086] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:04.359946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e3636-fb89-4ded-a1f7-15f39d42cbbf None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:04.468233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e3636-fb89-4ded-a1f7-15f39d42cbbf None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:04.505339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf5d94-3ca2-4b77-a007-c9c270bad259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:04.506069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf5d94-3ca2-4b77-a007-c9c270bad259 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:04.506354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf5d94-3ca2-4b77-a007-c9c270bad259 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:04.506630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf5d94-3ca2-4b77-a007-c9c270bad259 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:04.519138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf5d94-3ca2-4b77-a007-c9c270bad259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-5dbf5d94-3ca2-4b77-a007-c9c270bad259 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:19:04.527884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:04.529077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:04.530064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 551/1087] 10.222.0.75 () {56 vars in 1120 bytes} [Thu May 12 14:19:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:04.535769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d60b2-52f5-41be-b801-ca86099aef9b None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:04.635210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d60b2-52f5-41be-b801-ca86099aef9b None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:04.669871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4d8d7-8b05-4bf0-97c2-fe138482a688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:04.670545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4d8d7-8b05-4bf0-97c2-fe138482a688 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:04.670825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4d8d7-8b05-4bf0-97c2-fe138482a688 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:04.671129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4d8d7-8b05-4bf0-97c2-fe138482a688 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:04.671883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4d8d7-8b05-4bf0-97c2-fe138482a688 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:04.674688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4d8d7-8b05-4bf0-97c2-fe138482a688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:04.674688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4d8d7-8b05-4bf0-97c2-fe138482a688 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:04.682050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 537/1088] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 12 14:19:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:04.688245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf5d94-3ca2-4b77-a007-c9c270bad259 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:04.711942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79869343-7ff5-49a3-9243-7e2374c0656a None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:04.712226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79869343-7ff5-49a3-9243-7e2374c0656a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:04.712503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79869343-7ff5-49a3-9243-7e2374c0656a None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:04.713943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 538/1089] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:19:04.719310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa4da6-8fe9-4791-ab46-a210ddfc94dc None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:04.719602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa4da6-8fe9-4791-ab46-a210ddfc94dc None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:04.719880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa4da6-8fe9-4791-ab46-a210ddfc94dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:04.737302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-9afa4da6-8fe9-4791-ab46-a210ddfc94dc None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:04.738505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9afa4da6-8fe9-4791-ab46-a210ddfc94dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:04.787759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf5d94-3ca2-4b77-a007-c9c270bad259 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:04.805342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 539/1090] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:19:04.822372 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69831e54-e5eb-4421-baf2-c9f0ad86919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:04.823226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831e54-e5eb-4421-baf2-c9f0ad86919c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:04.823513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831e54-e5eb-4421-baf2-c9f0ad86919c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:04.823789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69831e54-e5eb-4421-baf2-c9f0ad86919c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:04.829215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa4da6-8fe9-4791-ab46-a210ddfc94dc None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:04.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69831e54-e5eb-4421-baf2-c9f0ad86919c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:04.836175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69831e54-e5eb-4421-baf2-c9f0ad86919c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-69831e54-e5eb-4421-baf2-c9f0ad86919c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:19:04.859276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:04.860444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:04.861386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:19:04.861386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:19:04.861386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:19:04.861386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:04.861386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 552/1091] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:04.866201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69831e54-e5eb-4421-baf2-c9f0ad86919c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:04.933448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa4da6-8fe9-4791-ab46-a210ddfc94dc None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:04.968095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0961c3c-59b0-44ac-8741-66e0617f54ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:04.968902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0961c3c-59b0-44ac-8741-66e0617f54ce None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:04.969183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0961c3c-59b0-44ac-8741-66e0617f54ce None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:04.969457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0961c3c-59b0-44ac-8741-66e0617f54ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:04.971581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69831e54-e5eb-4421-baf2-c9f0ad86919c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:04.980834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0961c3c-59b0-44ac-8741-66e0617f54ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-d0961c3c-59b0-44ac-8741-66e0617f54ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:19:04.988731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:04.989708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:19:04.990560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 540/1092] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:19:04.998130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0961c3c-59b0-44ac-8741-66e0617f54ce None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:05.014357 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9636-db70-4f11-bd40-9b54e40ae186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:05.015052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9636-db70-4f11-bd40-9b54e40ae186 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:05.015371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9636-db70-4f11-bd40-9b54e40ae186 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:05.015645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f9636-db70-4f11-bd40-9b54e40ae186 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:05.016373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f9636-db70-4f11-bd40-9b54e40ae186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:05.016681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f9636-db70-4f11-bd40-9b54e40ae186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:05.018064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f9636-db70-4f11-bd40-9b54e40ae186 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:05.030741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 553/1093] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:19:05.036516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9636-db70-4f11-bd40-9b54e40ae186 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:05.105475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0961c3c-59b0-44ac-8741-66e0617f54ce None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:05.134596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f9636-db70-4f11-bd40-9b54e40ae186 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:05.138260 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b4f1e-2c38-4f43-89df-6e92601b134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:05.138939 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b4f1e-2c38-4f43-89df-6e92601b134d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:05.139259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b4f1e-2c38-4f43-89df-6e92601b134d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:05.139534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b4f1e-2c38-4f43-89df-6e92601b134d None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:05.140292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b4f1e-2c38-4f43-89df-6e92601b134d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:05.140601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b4f1e-2c38-4f43-89df-6e92601b134d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:05.141991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b4f1e-2c38-4f43-89df-6e92601b134d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:05.150670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 541/1094] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:19:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:05.157090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b4f1e-2c38-4f43-89df-6e92601b134d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:05.172632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981d741-b486-49fb-a657-b1c504c0cf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:05.173438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981d741-b486-49fb-a657-b1c504c0cf92 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:05.173720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981d741-b486-49fb-a657-b1c504c0cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:05.173998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981d741-b486-49fb-a657-b1c504c0cf92 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:05.181326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981d741-b486-49fb-a657-b1c504c0cf92 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:05.182851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8981d741-b486-49fb-a657-b1c504c0cf92 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-8981d741-b486-49fb-a657-b1c504c0cf92 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:19:05.197408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:05.198600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:05.199612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 554/1095] 10.222.0.75 () {56 vars in 1093 bytes} [Thu May 12 14:19:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:19:05.205152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981d741-b486-49fb-a657-b1c504c0cf92 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:05.255326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b4f1e-2c38-4f43-89df-6e92601b134d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:05.290560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d1519-f1a5-44b8-bcfc-9be0d1648d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:05.291476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d1519-f1a5-44b8-bcfc-9be0d1648d81 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:05.292272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d1519-f1a5-44b8-bcfc-9be0d1648d81 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:05.292560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d1519-f1a5-44b8-bcfc-9be0d1648d81 None admin] PATH_INFO: `/v3/users/a2d4b029b944408ea7943483192a4d32` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:05.293827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d1519-f1a5-44b8-bcfc-9be0d1648d81 None admin] RBAC: Authorizing `identity:get_user(user_id=a2d4b029b944408ea7943483192a4d32)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:05.295293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d1519-f1a5-44b8-bcfc-9be0d1648d81 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:05.296951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 542/1096] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:05 2022] GET /identity/v3/users/a2d4b029b944408ea7943483192a4d32 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:19:05.302730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d1519-f1a5-44b8-bcfc-9be0d1648d81 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:05.312536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8981d741-b486-49fb-a657-b1c504c0cf92 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:05.346686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deddf4-4bbf-4b1d-bc1f-c658f95eb638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:05.347411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deddf4-4bbf-4b1d-bc1f-c658f95eb638 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:05.347690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deddf4-4bbf-4b1d-bc1f-c658f95eb638 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:05.347963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64deddf4-4bbf-4b1d-bc1f-c658f95eb638 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:05.348810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deddf4-4bbf-4b1d-bc1f-c658f95eb638 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:05.349118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deddf4-4bbf-4b1d-bc1f-c658f95eb638 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:05.350565 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64deddf4-4bbf-4b1d-bc1f-c658f95eb638 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:05.368106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 555/1097] 10.222.0.75 () {56 vars in 1133 bytes} [Thu May 12 14:19:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:05.373701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deddf4-4bbf-4b1d-bc1f-c658f95eb638 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:05.412130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d1519-f1a5-44b8-bcfc-9be0d1648d81 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:05.444542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2698a-568d-4e58-bf59-f91af9f9457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:05.445197 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2698a-568d-4e58-bf59-f91af9f9457c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:05.445476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2698a-568d-4e58-bf59-f91af9f9457c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:05.445750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2698a-568d-4e58-bf59-f91af9f9457c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:05.477924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64deddf4-4bbf-4b1d-bc1f-c658f95eb638 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:05.512882 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619307b-60ff-4793-9152-943ca884d5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:05.513538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619307b-60ff-4793-9152-943ca884d5d3 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:05.513760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2698a-568d-4e58-bf59-f91af9f9457c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:05.513860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619307b-60ff-4793-9152-943ca884d5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:05.514083 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619307b-60ff-4793-9152-943ca884d5d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:05.515257 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2698a-568d-4e58-bf59-f91af9f9457c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:05.582908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619307b-60ff-4793-9152-943ca884d5d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:05.584392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619307b-60ff-4793-9152-943ca884d5d3 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:05.630154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 543/1098] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:19:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 14:19:05.631204 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2698a-568d-4e58-bf59-f91af9f9457c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:05.690967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 556/1099] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:19:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 12 14:19:05.692142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619307b-60ff-4793-9152-943ca884d5d3 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:05.728909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2698a-568d-4e58-bf59-f91af9f9457c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:05.765148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad685ff5-ff43-4da0-870c-4f710fcae017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:05.766021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad685ff5-ff43-4da0-870c-4f710fcae017 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:05.766303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad685ff5-ff43-4da0-870c-4f710fcae017 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:05.766579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad685ff5-ff43-4da0-870c-4f710fcae017 None admin] PATH_INFO: `/v3/projects/ade4de1f43a249469fcdba6e9bee22de` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:05.767860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad685ff5-ff43-4da0-870c-4f710fcae017 None admin] RBAC: Authorizing `identity:get_project(project_id=ade4de1f43a249469fcdba6e9bee22de)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:05.769573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad685ff5-ff43-4da0-870c-4f710fcae017 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:05.771504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 544/1100] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:05 2022] GET /identity/v3/projects/ade4de1f43a249469fcdba6e9bee22de => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:19:05.777980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad685ff5-ff43-4da0-870c-4f710fcae017 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:05.790137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619307b-60ff-4793-9152-943ca884d5d3 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:05.824626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0243638-37b1-404f-bb0f-d124d1fd9f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:05.825416 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0243638-37b1-404f-bb0f-d124d1fd9f42 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:05.825694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0243638-37b1-404f-bb0f-d124d1fd9f42 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:05.825965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0243638-37b1-404f-bb0f-d124d1fd9f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:05.835851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0243638-37b1-404f-bb0f-d124d1fd9f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:05.837300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0243638-37b1-404f-bb0f-d124d1fd9f42 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-b0243638-37b1-404f-bb0f-d124d1fd9f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:19:05.855928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:05.856918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:05.857858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:19:05.857858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:19:05.857858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:19:05.857858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:05.857858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 557/1101] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:19:05.862915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0243638-37b1-404f-bb0f-d124d1fd9f42 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:05.875673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad685ff5-ff43-4da0-870c-4f710fcae017 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:05.909651 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bef594-f5d7-48f8-be07-7cb1e9660690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:05.910233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bef594-f5d7-48f8-be07-7cb1e9660690 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:05.910518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bef594-f5d7-48f8-be07-7cb1e9660690 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:05.910793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bef594-f5d7-48f8-be07-7cb1e9660690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:05.911653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bef594-f5d7-48f8-be07-7cb1e9660690 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=ade4de1f43a249469fcdba6e9bee22de, user.id=a2d4b029b944408ea7943483192a4d32) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:05.911966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bef594-f5d7-48f8-be07-7cb1e9660690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:05.913437 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bef594-f5d7-48f8-be07-7cb1e9660690 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:05.920201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 545/1102] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:19:05 2022] GET /identity/v3/role_assignments?user.id=a2d4b029b944408ea7943483192a4d32&scope.project.id=ade4de1f43a249469fcdba6e9bee22de&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:19:05.974345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0243638-37b1-404f-bb0f-d124d1fd9f42 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:06.013570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab2888-8fd9-4877-b2bc-1ef690564a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:06.013570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab2888-8fd9-4877-b2bc-1ef690564a8f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:06.013925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab2888-8fd9-4877-b2bc-1ef690564a8f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:06.014013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab2888-8fd9-4877-b2bc-1ef690564a8f None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:06.014749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab2888-8fd9-4877-b2bc-1ef690564a8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:06.015076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab2888-8fd9-4877-b2bc-1ef690564a8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:06.016496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab2888-8fd9-4877-b2bc-1ef690564a8f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:06.029782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 558/1103] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:19:06.035710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bef594-f5d7-48f8-be07-7cb1e9660690 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:06.141648 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bef594-f5d7-48f8-be07-7cb1e9660690 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:06.178154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcce2b-3f6c-40a8-9db7-661f3c855132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:06.178875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcce2b-3f6c-40a8-9db7-661f3c855132 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:06.179233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcce2b-3f6c-40a8-9db7-661f3c855132 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:06.179508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcce2b-3f6c-40a8-9db7-661f3c855132 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:06.187063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcce2b-3f6c-40a8-9db7-661f3c855132 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:06.188501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcce2b-3f6c-40a8-9db7-661f3c855132 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-3fbcce2b-3f6c-40a8-9db7-661f3c855132 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:19:06.202692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:06.203852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:06.205992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:19:06.205992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:19:06.205992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:19:06.205992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:19:06.205992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:19:06.205992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:19:06.205992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:19:06.205992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:19:06.205992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 546/1104] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:06.211613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab2888-8fd9-4877-b2bc-1ef690564a8f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:06.310956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab2888-8fd9-4877-b2bc-1ef690564a8f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:06.351834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492cbd9-816e-4774-8a74-f0fd1102e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:06.352510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492cbd9-816e-4774-8a74-f0fd1102e542 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:06.352795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492cbd9-816e-4774-8a74-f0fd1102e542 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:06.353071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492cbd9-816e-4774-8a74-f0fd1102e542 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:06.353878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492cbd9-816e-4774-8a74-f0fd1102e542 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:06.354726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492cbd9-816e-4774-8a74-f0fd1102e542 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:06.356326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492cbd9-816e-4774-8a74-f0fd1102e542 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:06.368949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 559/1105] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:06.375574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcce2b-3f6c-40a8-9db7-661f3c855132 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:06.474247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcce2b-3f6c-40a8-9db7-661f3c855132 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:06.507523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e99ca-be8f-42ca-be55-817d1bf3204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:06.508183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e99ca-be8f-42ca-be55-817d1bf3204a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:06.508465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e99ca-be8f-42ca-be55-817d1bf3204a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:06.508738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e99ca-be8f-42ca-be55-817d1bf3204a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:06.509585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e99ca-be8f-42ca-be55-817d1bf3204a None admin] RBAC: Adding query filter params (role.id=e94b956e022144e290eedad9d5911aad, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=2366609a0a564e7fbcb05b503de78580) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:06.509927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e99ca-be8f-42ca-be55-817d1bf3204a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:06.511387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e99ca-be8f-42ca-be55-817d1bf3204a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:06.517534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 547/1106] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:19:06 2022] GET /identity/v3/role_assignments?user.id=2366609a0a564e7fbcb05b503de78580&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=e94b956e022144e290eedad9d5911aad => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:19:08.211386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b41a-2cca-428c-a183-ae21c7aac371 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:08.211913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b41a-2cca-428c-a183-ae21c7aac371 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:08.211913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6b41a-2cca-428c-a183-ae21c7aac371 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:08.213304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 560/1107] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:08.218933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cc883-a7bd-427e-ad90-3c8f71b943e3 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:08.219431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cc883-a7bd-427e-ad90-3c8f71b943e3 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:08.219523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cc883-a7bd-427e-ad90-3c8f71b943e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:08.236710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-ec2cc883-a7bd-427e-ad90-3c8f71b943e3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:08.237917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ec2cc883-a7bd-427e-ad90-3c8f71b943e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:08.303100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 548/1108] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:08.328326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b41a-2cca-428c-a183-ae21c7aac371 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:08.431580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6b41a-2cca-428c-a183-ae21c7aac371 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:08.464999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937da7e-9e7c-43d1-a640-a2602fdced36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:08.465785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937da7e-9e7c-43d1-a640-a2602fdced36 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:08.466066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937da7e-9e7c-43d1-a640-a2602fdced36 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:08.466338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937da7e-9e7c-43d1-a640-a2602fdced36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:08.467554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937da7e-9e7c-43d1-a640-a2602fdced36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:08.469046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937da7e-9e7c-43d1-a640-a2602fdced36 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:08.470627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 561/1109] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:19:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:08.476338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cc883-a7bd-427e-ad90-3c8f71b943e3 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:08.573670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cc883-a7bd-427e-ad90-3c8f71b943e3 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:08.607499 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea990fa-f217-4ffa-9359-3a46f2748bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:08.608172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea990fa-f217-4ffa-9359-3a46f2748bcc None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:08.608456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea990fa-f217-4ffa-9359-3a46f2748bcc None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:08.608732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea990fa-f217-4ffa-9359-3a46f2748bcc None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:08.609450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea990fa-f217-4ffa-9359-3a46f2748bcc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:08.610880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea990fa-f217-4ffa-9359-3a46f2748bcc None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:08.632455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 549/1110] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:19:08 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:19:10.900631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c13ba-13cb-496a-830b-4e56aeecd698 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:10.901687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c13ba-13cb-496a-830b-4e56aeecd698 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:10.901687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c13ba-13cb-496a-830b-4e56aeecd698 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:10.903061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 562/1111] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:10.908833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afbaf5-c71b-4584-92ae-9f593faf4f20 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:10.909278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afbaf5-c71b-4584-92ae-9f593faf4f20 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:10.909393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afbaf5-c71b-4584-92ae-9f593faf4f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:10.926710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c6afbaf5-c71b-4584-92ae-9f593faf4f20 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:10.928027 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c6afbaf5-c71b-4584-92ae-9f593faf4f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:10.991542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 550/1112] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:11.015556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c13ba-13cb-496a-830b-4e56aeecd698 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:11.118143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c13ba-13cb-496a-830b-4e56aeecd698 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:11.151134 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e24503-54f8-40e8-b997-ca1fa3e52f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:11.151922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e24503-54f8-40e8-b997-ca1fa3e52f48 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:11.152201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e24503-54f8-40e8-b997-ca1fa3e52f48 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:11.152474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e24503-54f8-40e8-b997-ca1fa3e52f48 None admin] PATH_INFO: `/v3/roles/8b437ce0fad84637a68c6c151d4e2c5c` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:11.153938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e24503-54f8-40e8-b997-ca1fa3e52f48 None admin] RBAC: Authorizing `identity:get_role(role_id=8b437ce0fad84637a68c6c151d4e2c5c)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:11.155350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e24503-54f8-40e8-b997-ca1fa3e52f48 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:11.157004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 563/1113] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:11 2022] GET /identity/v3/roles/8b437ce0fad84637a68c6c151d4e2c5c => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:11.163088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afbaf5-c71b-4584-92ae-9f593faf4f20 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:11.259464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afbaf5-c71b-4584-92ae-9f593faf4f20 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:11.294674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e415abb-c074-4d68-a691-24fbf7432d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:11.295568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e415abb-c074-4d68-a691-24fbf7432d63 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:11.295846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e415abb-c074-4d68-a691-24fbf7432d63 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:11.296120 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e415abb-c074-4d68-a691-24fbf7432d63 None admin] PATH_INFO: `/v3/users/bf3dbd837b0d4f6baef01baff7350b5e` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:11.310532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e415abb-c074-4d68-a691-24fbf7432d63 None admin] RBAC: Authorizing `identity:get_user(user_id=bf3dbd837b0d4f6baef01baff7350b5e)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:11.312010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e415abb-c074-4d68-a691-24fbf7432d63 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:11.313716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 551/1114] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:11 2022] GET /identity/v3/users/bf3dbd837b0d4f6baef01baff7350b5e => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:11.319646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e24503-54f8-40e8-b997-ca1fa3e52f48 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:11.421418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e24503-54f8-40e8-b997-ca1fa3e52f48 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:11.454938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34e4b-e5da-4b23-9288-8215c69b1c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:11.455625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34e4b-e5da-4b23-9288-8215c69b1c5d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:11.455914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34e4b-e5da-4b23-9288-8215c69b1c5d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:11.456194 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a34e4b-e5da-4b23-9288-8215c69b1c5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:11.523400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a34e4b-e5da-4b23-9288-8215c69b1c5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:11.524997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a34e4b-e5da-4b23-9288-8215c69b1c5d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:11.626139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 564/1115] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:19:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:19:11.632278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e415abb-c074-4d68-a691-24fbf7432d63 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:11.727861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e415abb-c074-4d68-a691-24fbf7432d63 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:11.760862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b387b08-92a0-4e67-b126-bcf3d95fc6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:11.761723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b387b08-92a0-4e67-b126-bcf3d95fc6d8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:11.762003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b387b08-92a0-4e67-b126-bcf3d95fc6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:11.762278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b387b08-92a0-4e67-b126-bcf3d95fc6d8 None admin] PATH_INFO: `/v3/projects/ade4de1f43a249469fcdba6e9bee22de` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:11.763491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b387b08-92a0-4e67-b126-bcf3d95fc6d8 None admin] RBAC: Authorizing `identity:get_project(project_id=ade4de1f43a249469fcdba6e9bee22de)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:11.764922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b387b08-92a0-4e67-b126-bcf3d95fc6d8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:11.766727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 552/1116] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:11 2022] GET /identity/v3/projects/ade4de1f43a249469fcdba6e9bee22de => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:11.773168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34e4b-e5da-4b23-9288-8215c69b1c5d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:11.869829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a34e4b-e5da-4b23-9288-8215c69b1c5d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:11.903318 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f4502-aafc-41b4-bbb8-d13f82952714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:11.903968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4502-aafc-41b4-bbb8-d13f82952714 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:11.904229 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4502-aafc-41b4-bbb8-d13f82952714 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:11.904500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f4502-aafc-41b4-bbb8-d13f82952714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:11.905320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f4502-aafc-41b4-bbb8-d13f82952714 None admin] RBAC: Adding query filter params (role.id=8b437ce0fad84637a68c6c151d4e2c5c, scope.project.id=ade4de1f43a249469fcdba6e9bee22de, user.id=bf3dbd837b0d4f6baef01baff7350b5e) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:11.905625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f4502-aafc-41b4-bbb8-d13f82952714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:11.907074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f4502-aafc-41b4-bbb8-d13f82952714 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:11.912551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 565/1117] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:19:11 2022] GET /identity/v3/role_assignments?user.id=bf3dbd837b0d4f6baef01baff7350b5e&scope.project.id=ade4de1f43a249469fcdba6e9bee22de&role.id=8b437ce0fad84637a68c6c151d4e2c5c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:14.120194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de1f6-8ce0-4dba-b90c-ae80aa542dce None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:14.120758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de1f6-8ce0-4dba-b90c-ae80aa542dce None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:14.120758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de1f6-8ce0-4dba-b90c-ae80aa542dce None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:14.122105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 553/1118] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:14.127775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81d41-d1fc-44a5-adf2-7882e7d2ef09 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:14.128263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81d41-d1fc-44a5-adf2-7882e7d2ef09 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:14.128356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b81d41-d1fc-44a5-adf2-7882e7d2ef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:14.145767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-71b81d41-d1fc-44a5-adf2-7882e7d2ef09 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:14.146955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-71b81d41-d1fc-44a5-adf2-7882e7d2ef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:14.213942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 566/1119] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:19:14.236411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20de1f6-8ce0-4dba-b90c-ae80aa542dce None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:14.339506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20de1f6-8ce0-4dba-b90c-ae80aa542dce None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:14.373332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe671e-168a-4dc8-8701-8c3bce768b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:14.374188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe671e-168a-4dc8-8701-8c3bce768b46 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:14.374466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe671e-168a-4dc8-8701-8c3bce768b46 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:14.374735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe671e-168a-4dc8-8701-8c3bce768b46 None admin] PATH_INFO: `/v3/roles/8b437ce0fad84637a68c6c151d4e2c5c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:14.376227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe671e-168a-4dc8-8701-8c3bce768b46 None admin] RBAC: Authorizing `identity:get_role(role_id=8b437ce0fad84637a68c6c151d4e2c5c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:14.377594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe671e-168a-4dc8-8701-8c3bce768b46 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:14.378963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 554/1120] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:14 2022] GET /identity/v3/roles/8b437ce0fad84637a68c6c151d4e2c5c => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:14.384865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81d41-d1fc-44a5-adf2-7882e7d2ef09 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:14.478449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b81d41-d1fc-44a5-adf2-7882e7d2ef09 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:14.513275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b759-f03a-4cdc-addb-cd965dc5ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:14.514055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b759-f03a-4cdc-addb-cd965dc5ecf2 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:14.514332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b759-f03a-4cdc-addb-cd965dc5ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:14.514600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b759-f03a-4cdc-addb-cd965dc5ecf2 None admin] PATH_INFO: `/v3/users/bf3dbd837b0d4f6baef01baff7350b5e` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:14.515818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874b759-f03a-4cdc-addb-cd965dc5ecf2 None admin] RBAC: Authorizing `identity:get_user(user_id=bf3dbd837b0d4f6baef01baff7350b5e)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:14.517260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874b759-f03a-4cdc-addb-cd965dc5ecf2 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:14.518888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 567/1121] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:14 2022] GET /identity/v3/users/bf3dbd837b0d4f6baef01baff7350b5e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:14.525169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe671e-168a-4dc8-8701-8c3bce768b46 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:14.623634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe671e-168a-4dc8-8701-8c3bce768b46 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:14.656314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84739ed5-9c76-4c80-80cf-301170f8ef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:14.657176 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739ed5-9c76-4c80-80cf-301170f8ef46 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:14.657458 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739ed5-9c76-4c80-80cf-301170f8ef46 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:14.657736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84739ed5-9c76-4c80-80cf-301170f8ef46 None admin] PATH_INFO: `/v3/projects/ade4de1f43a249469fcdba6e9bee22de` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:14.658927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84739ed5-9c76-4c80-80cf-301170f8ef46 None admin] RBAC: Authorizing `identity:get_project(project_id=ade4de1f43a249469fcdba6e9bee22de)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:14.660397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84739ed5-9c76-4c80-80cf-301170f8ef46 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:14.662110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 555/1122] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:14 2022] GET /identity/v3/projects/ade4de1f43a249469fcdba6e9bee22de => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:19:14.668685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b759-f03a-4cdc-addb-cd965dc5ecf2 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:14.762463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b759-f03a-4cdc-addb-cd965dc5ecf2 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:14.797061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3bed1-68f6-40ea-88e5-10c4ad3a0d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:14.797863 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3bed1-68f6-40ea-88e5-10c4ad3a0d90 None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:14.798144 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3bed1-68f6-40ea-88e5-10c4ad3a0d90 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:14.798416 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3bed1-68f6-40ea-88e5-10c4ad3a0d90 None admin] PATH_INFO: `/v3/projects/ade4de1f43a249469fcdba6e9bee22de/users/bf3dbd837b0d4f6baef01baff7350b5e/roles/8b437ce0fad84637a68c6c151d4e2c5c` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:14.800613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3bed1-68f6-40ea-88e5-10c4ad3a0d90 None admin] RBAC: Authorizing `identity:create_grant(project_id=ade4de1f43a249469fcdba6e9bee22de, user_id=bf3dbd837b0d4f6baef01baff7350b5e, role_id=8b437ce0fad84637a68c6c151d4e2c5c)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:14.802079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3bed1-68f6-40ea-88e5-10c4ad3a0d90 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:14.816499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 568/1123] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:19:14 2022] PUT /identity/v3/projects/ade4de1f43a249469fcdba6e9bee22de/users/bf3dbd837b0d4f6baef01baff7350b5e/roles/8b437ce0fad84637a68c6c151d4e2c5c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:19:17.031503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0292438-5aea-4080-93bd-fa8e67e3efbe None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:17.032033 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0292438-5aea-4080-93bd-fa8e67e3efbe None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:17.032122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0292438-5aea-4080-93bd-fa8e67e3efbe None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:17.033435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 556/1124] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:17.038751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327341a-7f59-4224-ae8d-356926aabb72 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:17.039185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327341a-7f59-4224-ae8d-356926aabb72 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:17.039336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327341a-7f59-4224-ae8d-356926aabb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:17.057845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6327341a-7f59-4224-ae8d-356926aabb72 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:17.059048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6327341a-7f59-4224-ae8d-356926aabb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:17.127661 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 569/1125] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:17.151928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0292438-5aea-4080-93bd-fa8e67e3efbe None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:17.252713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0292438-5aea-4080-93bd-fa8e67e3efbe None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:17.285416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ef321-08a0-428b-bf1d-223c936820da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:17.286274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ef321-08a0-428b-bf1d-223c936820da None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:17.286556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ef321-08a0-428b-bf1d-223c936820da None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:17.286833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ef321-08a0-428b-bf1d-223c936820da None admin] PATH_INFO: `/v3/roles/8b437ce0fad84637a68c6c151d4e2c5c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:17.288327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ef321-08a0-428b-bf1d-223c936820da None admin] RBAC: Authorizing `identity:get_role(role_id=8b437ce0fad84637a68c6c151d4e2c5c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:17.289704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ef321-08a0-428b-bf1d-223c936820da None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:17.291103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 557/1126] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:17 2022] GET /identity/v3/roles/8b437ce0fad84637a68c6c151d4e2c5c => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:17.296975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327341a-7f59-4224-ae8d-356926aabb72 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:17.392081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327341a-7f59-4224-ae8d-356926aabb72 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:17.425695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb2a33-536b-414c-86da-fa907c6d58de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:17.426554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2a33-536b-414c-86da-fa907c6d58de None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:17.426829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2a33-536b-414c-86da-fa907c6d58de None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:17.427122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2a33-536b-414c-86da-fa907c6d58de None admin] PATH_INFO: `/v3/users/bf3dbd837b0d4f6baef01baff7350b5e` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:17.428299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb2a33-536b-414c-86da-fa907c6d58de None admin] RBAC: Authorizing `identity:get_user(user_id=bf3dbd837b0d4f6baef01baff7350b5e)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:17.429735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb2a33-536b-414c-86da-fa907c6d58de None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:17.431401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 570/1127] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:17 2022] GET /identity/v3/users/bf3dbd837b0d4f6baef01baff7350b5e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:17.437380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ef321-08a0-428b-bf1d-223c936820da None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:17.539232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ef321-08a0-428b-bf1d-223c936820da None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:17.571960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaecc2-c9d1-4316-8407-9738f00a0847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:17.573122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaecc2-c9d1-4316-8407-9738f00a0847 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:17.573404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaecc2-c9d1-4316-8407-9738f00a0847 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:17.573682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaecc2-c9d1-4316-8407-9738f00a0847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:17.638915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaecc2-c9d1-4316-8407-9738f00a0847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:17.640392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaecc2-c9d1-4316-8407-9738f00a0847 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:17.734829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 558/1128] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:19:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:19:17.740668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb2a33-536b-414c-86da-fa907c6d58de None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:17.837237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb2a33-536b-414c-86da-fa907c6d58de None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:17.872859 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26836c07-8507-4046-b66a-f83716920740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:17.873703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26836c07-8507-4046-b66a-f83716920740 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:17.873982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26836c07-8507-4046-b66a-f83716920740 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:17.874261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26836c07-8507-4046-b66a-f83716920740 None admin] PATH_INFO: `/v3/projects/ade4de1f43a249469fcdba6e9bee22de` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:17.875454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26836c07-8507-4046-b66a-f83716920740 None admin] RBAC: Authorizing `identity:get_project(project_id=ade4de1f43a249469fcdba6e9bee22de)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:17.876890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26836c07-8507-4046-b66a-f83716920740 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:17.878658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 571/1129] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:17 2022] GET /identity/v3/projects/ade4de1f43a249469fcdba6e9bee22de => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:17.884784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaecc2-c9d1-4316-8407-9738f00a0847 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:17.991645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaecc2-c9d1-4316-8407-9738f00a0847 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:18.026392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146f00a-1039-4d7d-baa3-b5d7dd1fe042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:18.027070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146f00a-1039-4d7d-baa3-b5d7dd1fe042 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:18.027352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146f00a-1039-4d7d-baa3-b5d7dd1fe042 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:18.027625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146f00a-1039-4d7d-baa3-b5d7dd1fe042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:18.028454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146f00a-1039-4d7d-baa3-b5d7dd1fe042 None admin] RBAC: Adding query filter params (role.id=8b437ce0fad84637a68c6c151d4e2c5c, scope.project.id=ade4de1f43a249469fcdba6e9bee22de, user.id=bf3dbd837b0d4f6baef01baff7350b5e) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:18.028762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146f00a-1039-4d7d-baa3-b5d7dd1fe042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:18.030182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146f00a-1039-4d7d-baa3-b5d7dd1fe042 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:18.036044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 559/1130] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:19:17 2022] GET /identity/v3/role_assignments?user.id=bf3dbd837b0d4f6baef01baff7350b5e&scope.project.id=ade4de1f43a249469fcdba6e9bee22de&role.id=8b437ce0fad84637a68c6c151d4e2c5c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:20.305235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c1f65-d1af-4e61-9dfa-aae585bf1d60 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:20.305744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c1f65-d1af-4e61-9dfa-aae585bf1d60 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:20.305744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c1f65-d1af-4e61-9dfa-aae585bf1d60 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:20.307622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 572/1131] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:20.313141 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa619e3-1ed9-4c1b-85a0-e647d207e18e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:20.313614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa619e3-1ed9-4c1b-85a0-e647d207e18e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:20.313707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa619e3-1ed9-4c1b-85a0-e647d207e18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:20.330907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-8fa619e3-1ed9-4c1b-85a0-e647d207e18e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:20.332138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8fa619e3-1ed9-4c1b-85a0-e647d207e18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:20.397576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 560/1132] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:20.421863 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c1f65-d1af-4e61-9dfa-aae585bf1d60 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:20.520952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c1f65-d1af-4e61-9dfa-aae585bf1d60 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:20.561342 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50915ee1-761e-4bf4-bac0-e1ee4ba1d2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:20.562052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50915ee1-761e-4bf4-bac0-e1ee4ba1d2b3 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:20.562338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50915ee1-761e-4bf4-bac0-e1ee4ba1d2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:20.562619 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50915ee1-761e-4bf4-bac0-e1ee4ba1d2b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:20.563851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50915ee1-761e-4bf4-bac0-e1ee4ba1d2b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:20.565305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50915ee1-761e-4bf4-bac0-e1ee4ba1d2b3 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:20.566947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 573/1133] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:19:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:20.573401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa619e3-1ed9-4c1b-85a0-e647d207e18e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:20.667750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa619e3-1ed9-4c1b-85a0-e647d207e18e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:20.701451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1b1ec-1dc2-4520-8bcc-3ebda9231704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:20.702114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1b1ec-1dc2-4520-8bcc-3ebda9231704 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:20.702398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1b1ec-1dc2-4520-8bcc-3ebda9231704 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:20.702676 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1b1ec-1dc2-4520-8bcc-3ebda9231704 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:20.703428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1b1ec-1dc2-4520-8bcc-3ebda9231704 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:20.704867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1b1ec-1dc2-4520-8bcc-3ebda9231704 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:20.732095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 561/1134] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:19:20 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:19:23.005098 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abd9c7-091a-4f78-8075-d5c8bfeb7796 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:23.005622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abd9c7-091a-4f78-8075-d5c8bfeb7796 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:23.005713 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abd9c7-091a-4f78-8075-d5c8bfeb7796 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:23.007022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 574/1135] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:23.012605 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fb2e5-2593-476e-a49f-1220e81900c5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:23.013078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fb2e5-2593-476e-a49f-1220e81900c5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:23.013171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fb2e5-2593-476e-a49f-1220e81900c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:23.030650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-368fb2e5-2593-476e-a49f-1220e81900c5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:23.031885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-368fb2e5-2593-476e-a49f-1220e81900c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:23.101224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 562/1136] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:23.128169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abd9c7-091a-4f78-8075-d5c8bfeb7796 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:23.232413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abd9c7-091a-4f78-8075-d5c8bfeb7796 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:23.266226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159d038-d47f-4b10-8132-994c379b5307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:23.267023 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d038-d47f-4b10-8132-994c379b5307 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:23.267334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d038-d47f-4b10-8132-994c379b5307 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:23.267608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159d038-d47f-4b10-8132-994c379b5307 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:23.269122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159d038-d47f-4b10-8132-994c379b5307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:23.270613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159d038-d47f-4b10-8132-994c379b5307 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:23.272392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 575/1137] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:19:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:23.278444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fb2e5-2593-476e-a49f-1220e81900c5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:23.378820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fb2e5-2593-476e-a49f-1220e81900c5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:23.411915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc0c96-2509-4425-a932-074184f04bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:23.412573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc0c96-2509-4425-a932-074184f04bb7 None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:23.412849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc0c96-2509-4425-a932-074184f04bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:23.413119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc0c96-2509-4425-a932-074184f04bb7 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:23.413820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc0c96-2509-4425-a932-074184f04bb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:23.415546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc0c96-2509-4425-a932-074184f04bb7 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:23.437806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 563/1138] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:19:23 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:19:25.711494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b84cc-a24a-4ff7-8a98-da6b30c5dd9d None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:25.712054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b84cc-a24a-4ff7-8a98-da6b30c5dd9d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:25.712054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b84cc-a24a-4ff7-8a98-da6b30c5dd9d None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:25.714039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 576/1139] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:25.719490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7c375-f80b-472f-9b94-99ebfb433e5a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:25.719922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7c375-f80b-472f-9b94-99ebfb433e5a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:25.720048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7c375-f80b-472f-9b94-99ebfb433e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:25.736941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b4b7c375-f80b-472f-9b94-99ebfb433e5a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:25.738133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b4b7c375-f80b-472f-9b94-99ebfb433e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:25.806297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 564/1140] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:25.830837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b84cc-a24a-4ff7-8a98-da6b30c5dd9d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:25.944615 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b84cc-a24a-4ff7-8a98-da6b30c5dd9d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:25.979351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82f9b7-4b89-4c43-a407-53a9f3e7f27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:25.980154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82f9b7-4b89-4c43-a407-53a9f3e7f27e None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:25.980439 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82f9b7-4b89-4c43-a407-53a9f3e7f27e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:25.980717 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82f9b7-4b89-4c43-a407-53a9f3e7f27e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:25.990957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82f9b7-4b89-4c43-a407-53a9f3e7f27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-3c82f9b7-4b89-4c43-a407-53a9f3e7f27e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:19:25.999183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:26.000402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:26.001649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 577/1141] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:19:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:26.006596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7c375-f80b-472f-9b94-99ebfb433e5a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:26.100415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7c375-f80b-472f-9b94-99ebfb433e5a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:26.136376 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223be39e-d041-4698-a8fa-074c2ed12d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:26.137050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223be39e-d041-4698-a8fa-074c2ed12d7e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:26.137333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223be39e-d041-4698-a8fa-074c2ed12d7e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:26.137606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223be39e-d041-4698-a8fa-074c2ed12d7e None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:26.138357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223be39e-d041-4698-a8fa-074c2ed12d7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:26.138663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223be39e-d041-4698-a8fa-074c2ed12d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:26.140064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223be39e-d041-4698-a8fa-074c2ed12d7e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:26.148522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 565/1142] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:26.155151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82f9b7-4b89-4c43-a407-53a9f3e7f27e None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:26.249927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82f9b7-4b89-4c43-a407-53a9f3e7f27e None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:26.284132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6d946-850f-42ca-aa02-1de293154d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:26.285000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6d946-850f-42ca-aa02-1de293154d03 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:26.285276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6d946-850f-42ca-aa02-1de293154d03 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:26.285548 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6d946-850f-42ca-aa02-1de293154d03 None admin] PATH_INFO: `/v3/users/2ab723b0f5ad4ed2a141b457279dce8f` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:26.299048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6d946-850f-42ca-aa02-1de293154d03 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab723b0f5ad4ed2a141b457279dce8f)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:26.300510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6d946-850f-42ca-aa02-1de293154d03 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:26.302184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 578/1143] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:26 2022] GET /identity/v3/users/2ab723b0f5ad4ed2a141b457279dce8f => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:26.308185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223be39e-d041-4698-a8fa-074c2ed12d7e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:26.402459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223be39e-d041-4698-a8fa-074c2ed12d7e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:26.435298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525b1d3-bee1-4b85-aca9-56a731111635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:26.435951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b1d3-bee1-4b85-aca9-56a731111635 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:26.436233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b1d3-bee1-4b85-aca9-56a731111635 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:26.436511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b1d3-bee1-4b85-aca9-56a731111635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:26.520766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525b1d3-bee1-4b85-aca9-56a731111635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:26.522126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525b1d3-bee1-4b85-aca9-56a731111635 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:26.616922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 566/1144] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:19:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:19:26.622822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6d946-850f-42ca-aa02-1de293154d03 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:26.718489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6d946-850f-42ca-aa02-1de293154d03 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:26.754763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae2e8b-38a8-4c1f-846c-bfa4c5d5c3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:26.755657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae2e8b-38a8-4c1f-846c-bfa4c5d5c3b8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:26.755941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae2e8b-38a8-4c1f-846c-bfa4c5d5c3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:26.756217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae2e8b-38a8-4c1f-846c-bfa4c5d5c3b8 None admin] PATH_INFO: `/v3/projects/20932634e4424dd2ab5bcb0bb7e7453f` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:26.757405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae2e8b-38a8-4c1f-846c-bfa4c5d5c3b8 None admin] RBAC: Authorizing `identity:get_project(project_id=20932634e4424dd2ab5bcb0bb7e7453f)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:26.758851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae2e8b-38a8-4c1f-846c-bfa4c5d5c3b8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:26.761163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 579/1145] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:26 2022] GET /identity/v3/projects/20932634e4424dd2ab5bcb0bb7e7453f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:26.767269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525b1d3-bee1-4b85-aca9-56a731111635 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:26.861870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525b1d3-bee1-4b85-aca9-56a731111635 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:26.896509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567da1d-5dc9-4fcd-a3fb-d76cf5af1550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:26.897170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567da1d-5dc9-4fcd-a3fb-d76cf5af1550 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:26.897454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567da1d-5dc9-4fcd-a3fb-d76cf5af1550 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:26.897728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567da1d-5dc9-4fcd-a3fb-d76cf5af1550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:26.898563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567da1d-5dc9-4fcd-a3fb-d76cf5af1550 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=20932634e4424dd2ab5bcb0bb7e7453f, user.id=2ab723b0f5ad4ed2a141b457279dce8f) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:26.898872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567da1d-5dc9-4fcd-a3fb-d76cf5af1550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:26.900368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567da1d-5dc9-4fcd-a3fb-d76cf5af1550 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:26.905807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 567/1146] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:19:26 2022] GET /identity/v3/role_assignments?user.id=2ab723b0f5ad4ed2a141b457279dce8f&scope.project.id=20932634e4424dd2ab5bcb0bb7e7453f&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:29.110008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e9879-7c0e-47ea-bcc8-ce3d75286859 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:29.110550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e9879-7c0e-47ea-bcc8-ce3d75286859 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:29.110550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e9879-7c0e-47ea-bcc8-ce3d75286859 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:29.111954 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 580/1147] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:29.117060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cd828-2fc1-4260-8b13-d66acc17db51 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:29.117488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cd828-2fc1-4260-8b13-d66acc17db51 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:29.117616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cd828-2fc1-4260-8b13-d66acc17db51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:29.133814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-994cd828-2fc1-4260-8b13-d66acc17db51 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:29.135169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-994cd828-2fc1-4260-8b13-d66acc17db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:29.199282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 568/1148] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:19:29.222305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e9879-7c0e-47ea-bcc8-ce3d75286859 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:29.321255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e9879-7c0e-47ea-bcc8-ce3d75286859 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:29.357445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d610a1-3d9f-454e-9cb8-65db40679a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:29.358264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d610a1-3d9f-454e-9cb8-65db40679a59 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:29.358548 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d610a1-3d9f-454e-9cb8-65db40679a59 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:29.358822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d610a1-3d9f-454e-9cb8-65db40679a59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:29.368859 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d610a1-3d9f-454e-9cb8-65db40679a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-c6d610a1-3d9f-454e-9cb8-65db40679a59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:19:29.376513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:29.377646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:29.378523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 581/1149] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:19:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:29.383999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cd828-2fc1-4260-8b13-d66acc17db51 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:29.476790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cd828-2fc1-4260-8b13-d66acc17db51 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:29.509194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199614c5-51d2-4f8a-b716-86b07c6aa021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:29.509869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199614c5-51d2-4f8a-b716-86b07c6aa021 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:29.510156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199614c5-51d2-4f8a-b716-86b07c6aa021 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:29.510428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199614c5-51d2-4f8a-b716-86b07c6aa021 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:29.511203 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199614c5-51d2-4f8a-b716-86b07c6aa021 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:29.511511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199614c5-51d2-4f8a-b716-86b07c6aa021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:29.512878 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199614c5-51d2-4f8a-b716-86b07c6aa021 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:29.521189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 569/1150] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:19:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:29.527695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d610a1-3d9f-454e-9cb8-65db40679a59 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:29.624759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d610a1-3d9f-454e-9cb8-65db40679a59 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:29.666657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d106b2a-3e70-4c90-848f-c5a5f3da4236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:29.667877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d106b2a-3e70-4c90-848f-c5a5f3da4236 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:29.668152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d106b2a-3e70-4c90-848f-c5a5f3da4236 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:29.668425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d106b2a-3e70-4c90-848f-c5a5f3da4236 None admin] PATH_INFO: `/v3/users/2ab723b0f5ad4ed2a141b457279dce8f` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:29.669734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d106b2a-3e70-4c90-848f-c5a5f3da4236 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab723b0f5ad4ed2a141b457279dce8f)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:29.671233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d106b2a-3e70-4c90-848f-c5a5f3da4236 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:29.672946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 582/1151] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:29 2022] GET /identity/v3/users/2ab723b0f5ad4ed2a141b457279dce8f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:29.678837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199614c5-51d2-4f8a-b716-86b07c6aa021 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:29.782851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199614c5-51d2-4f8a-b716-86b07c6aa021 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:29.822609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18859413-5389-45e8-b151-af8e6629c574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:29.823888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859413-5389-45e8-b151-af8e6629c574 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:29.824284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859413-5389-45e8-b151-af8e6629c574 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:29.824694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18859413-5389-45e8-b151-af8e6629c574 None admin] PATH_INFO: `/v3/projects/20932634e4424dd2ab5bcb0bb7e7453f` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:29.826107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18859413-5389-45e8-b151-af8e6629c574 None admin] RBAC: Authorizing `identity:get_project(project_id=20932634e4424dd2ab5bcb0bb7e7453f)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:29.827575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18859413-5389-45e8-b151-af8e6629c574 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:29.829299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 570/1152] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:29 2022] GET /identity/v3/projects/20932634e4424dd2ab5bcb0bb7e7453f => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:29.835452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d106b2a-3e70-4c90-848f-c5a5f3da4236 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:29.934540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d106b2a-3e70-4c90-848f-c5a5f3da4236 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:29.972107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ae72-c292-409e-9081-abc01c13620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:29.973007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ae72-c292-409e-9081-abc01c13620e None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:29.973290 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ae72-c292-409e-9081-abc01c13620e None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:29.973566 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ae72-c292-409e-9081-abc01c13620e None admin] PATH_INFO: `/v3/projects/20932634e4424dd2ab5bcb0bb7e7453f/users/2ab723b0f5ad4ed2a141b457279dce8f/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:29.975583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ae72-c292-409e-9081-abc01c13620e None admin] RBAC: Authorizing `identity:create_grant(project_id=20932634e4424dd2ab5bcb0bb7e7453f, user_id=2ab723b0f5ad4ed2a141b457279dce8f, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:29.977044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ae72-c292-409e-9081-abc01c13620e None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:29.995567 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 583/1153] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:19:29 2022] PUT /identity/v3/projects/20932634e4424dd2ab5bcb0bb7e7453f/users/2ab723b0f5ad4ed2a141b457279dce8f/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:19:32.232102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff2d3-9835-49f5-bb57-fc19b0ba0ad8 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:32.232622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff2d3-9835-49f5-bb57-fc19b0ba0ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:32.232622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff2d3-9835-49f5-bb57-fc19b0ba0ad8 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:32.233986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 571/1154] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:32.239564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429ebf6-b11f-4dde-b3ef-f0b80228909b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:32.239979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429ebf6-b11f-4dde-b3ef-f0b80228909b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:32.240126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429ebf6-b11f-4dde-b3ef-f0b80228909b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:32.257267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d429ebf6-b11f-4dde-b3ef-f0b80228909b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:32.258598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d429ebf6-b11f-4dde-b3ef-f0b80228909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:32.327118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 584/1155] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:32.352080 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff2d3-9835-49f5-bb57-fc19b0ba0ad8 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:32.457935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff2d3-9835-49f5-bb57-fc19b0ba0ad8 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:32.490541 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ec4f0-53cb-42fe-a270-dbee72ae3ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:32.491281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ec4f0-53cb-42fe-a270-dbee72ae3ca0 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:32.491563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ec4f0-53cb-42fe-a270-dbee72ae3ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:32.491839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ec4f0-53cb-42fe-a270-dbee72ae3ca0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:32.502143 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ec4f0-53cb-42fe-a270-dbee72ae3ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-b02ec4f0-53cb-42fe-a270-dbee72ae3ca0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:19:32.510270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:32.511452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:19:32.512629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 572/1156] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:19:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:32.517761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429ebf6-b11f-4dde-b3ef-f0b80228909b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:32.614256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429ebf6-b11f-4dde-b3ef-f0b80228909b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:32.650417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeebf66-87a3-43c6-885c-57d1294be899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:32.651123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeebf66-87a3-43c6-885c-57d1294be899 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:32.651409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeebf66-87a3-43c6-885c-57d1294be899 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:32.651684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeebf66-87a3-43c6-885c-57d1294be899 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:32.652440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeebf66-87a3-43c6-885c-57d1294be899 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:32.652749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeebf66-87a3-43c6-885c-57d1294be899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:32.654132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeebf66-87a3-43c6-885c-57d1294be899 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:32.662234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 585/1157] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:19:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:32.667975 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ec4f0-53cb-42fe-a270-dbee72ae3ca0 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:32.761436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ec4f0-53cb-42fe-a270-dbee72ae3ca0 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:32.793163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceedc2-7ce7-4654-b1dc-29527ef9f975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:32.794019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceedc2-7ce7-4654-b1dc-29527ef9f975 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:32.794294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceedc2-7ce7-4654-b1dc-29527ef9f975 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:32.794563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceedc2-7ce7-4654-b1dc-29527ef9f975 None admin] PATH_INFO: `/v3/users/2ab723b0f5ad4ed2a141b457279dce8f` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:32.795699 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceedc2-7ce7-4654-b1dc-29527ef9f975 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab723b0f5ad4ed2a141b457279dce8f)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:32.797117 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceedc2-7ce7-4654-b1dc-29527ef9f975 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:32.798709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 573/1158] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:32 2022] GET /identity/v3/users/2ab723b0f5ad4ed2a141b457279dce8f => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:32.804389 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeebf66-87a3-43c6-885c-57d1294be899 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:32.898947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeebf66-87a3-43c6-885c-57d1294be899 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:32.929824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4812f1-a32e-407e-a697-3da30c2b2e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:32.930461 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4812f1-a32e-407e-a697-3da30c2b2e15 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:32.930743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4812f1-a32e-407e-a697-3da30c2b2e15 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:32.931019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4812f1-a32e-407e-a697-3da30c2b2e15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:32.995657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4812f1-a32e-407e-a697-3da30c2b2e15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:32.997113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4812f1-a32e-407e-a697-3da30c2b2e15 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:33.089353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 586/1159] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:19:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:19:33.095209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceedc2-7ce7-4654-b1dc-29527ef9f975 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:33.196607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceedc2-7ce7-4654-b1dc-29527ef9f975 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:33.231932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7debf8-4c03-4c41-b8e6-30615f9b453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:33.232792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7debf8-4c03-4c41-b8e6-30615f9b453c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:33.233346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7debf8-4c03-4c41-b8e6-30615f9b453c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:33.233346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7debf8-4c03-4c41-b8e6-30615f9b453c None admin] PATH_INFO: `/v3/projects/20932634e4424dd2ab5bcb0bb7e7453f` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:33.234490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7debf8-4c03-4c41-b8e6-30615f9b453c None admin] RBAC: Authorizing `identity:get_project(project_id=20932634e4424dd2ab5bcb0bb7e7453f)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:33.235949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7debf8-4c03-4c41-b8e6-30615f9b453c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:33.237654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 574/1160] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:33 2022] GET /identity/v3/projects/20932634e4424dd2ab5bcb0bb7e7453f => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:33.244308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4812f1-a32e-407e-a697-3da30c2b2e15 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:33.344793 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4812f1-a32e-407e-a697-3da30c2b2e15 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:33.384315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46baa925-209d-464f-abf4-f93374698260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:33.385472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa925-209d-464f-abf4-f93374698260 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:33.385756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa925-209d-464f-abf4-f93374698260 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:33.386319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46baa925-209d-464f-abf4-f93374698260 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:33.387787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baa925-209d-464f-abf4-f93374698260 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=20932634e4424dd2ab5bcb0bb7e7453f, user.id=2ab723b0f5ad4ed2a141b457279dce8f) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:33.388097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baa925-209d-464f-abf4-f93374698260 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:33.389542 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46baa925-209d-464f-abf4-f93374698260 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:33.395798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 587/1161] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:19:33 2022] GET /identity/v3/role_assignments?user.id=2ab723b0f5ad4ed2a141b457279dce8f&scope.project.id=20932634e4424dd2ab5bcb0bb7e7453f&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:35.640248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8ca95-bfcf-4f2d-86ef-b3b9966c88bf None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:35.640794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8ca95-bfcf-4f2d-86ef-b3b9966c88bf None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:35.640794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8ca95-bfcf-4f2d-86ef-b3b9966c88bf None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:35.642181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 575/1162] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:35.647810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c44ed-0bb6-4dea-b3d2-5a5937f3c6af None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:35.648258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c44ed-0bb6-4dea-b3d2-5a5937f3c6af None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:35.648358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c44ed-0bb6-4dea-b3d2-5a5937f3c6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:35.665075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-842c44ed-0bb6-4dea-b3d2-5a5937f3c6af None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:35.666931 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-842c44ed-0bb6-4dea-b3d2-5a5937f3c6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:35.729564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 588/1163] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:35.751516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8ca95-bfcf-4f2d-86ef-b3b9966c88bf None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:35.848441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8ca95-bfcf-4f2d-86ef-b3b9966c88bf None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:35.886952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce6cb0-2e38-44cc-919f-f836bcf116af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:35.887644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce6cb0-2e38-44cc-919f-f836bcf116af None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:35.887923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce6cb0-2e38-44cc-919f-f836bcf116af None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:35.888195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce6cb0-2e38-44cc-919f-f836bcf116af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:35.951716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce6cb0-2e38-44cc-919f-f836bcf116af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:35.953076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce6cb0-2e38-44cc-919f-f836bcf116af None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:36.046920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 576/1164] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:19:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:19:36.052869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c44ed-0bb6-4dea-b3d2-5a5937f3c6af None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:36.144340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c44ed-0bb6-4dea-b3d2-5a5937f3c6af None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:36.176247 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c20242-3682-42b2-a916-fc51b1935ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:36.177036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20242-3682-42b2-a916-fc51b1935ccb None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:36.177318 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20242-3682-42b2-a916-fc51b1935ccb None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:36.177590 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20242-3682-42b2-a916-fc51b1935ccb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:36.184351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c20242-3682-42b2-a916-fc51b1935ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:36.185783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c20242-3682-42b2-a916-fc51b1935ccb None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-87c20242-3682-42b2-a916-fc51b1935ccb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:36.199750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:36.201052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:36.202024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 589/1165] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 12 14:19:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:36.206979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce6cb0-2e38-44cc-919f-f836bcf116af None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:36.299977 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce6cb0-2e38-44cc-919f-f836bcf116af None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:36.333108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3779b-b6f3-455e-955b-00996fcad32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:36.333762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3779b-b6f3-455e-955b-00996fcad32d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:36.334047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3779b-b6f3-455e-955b-00996fcad32d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:36.334327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3779b-b6f3-455e-955b-00996fcad32d None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:36.335074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3779b-b6f3-455e-955b-00996fcad32d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:36.335385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3779b-b6f3-455e-955b-00996fcad32d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:36.336745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3779b-b6f3-455e-955b-00996fcad32d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:36.344161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 577/1166] 10.222.0.75 () {56 vars in 1115 bytes} [Thu May 12 14:19:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:38.547329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fea2a-373a-4f5c-a1ef-9b3d71cca68e None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:38.547898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fea2a-373a-4f5c-a1ef-9b3d71cca68e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:38.547898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fea2a-373a-4f5c-a1ef-9b3d71cca68e None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:38.549343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 590/1167] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:38.554673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78e4fa-b6a5-479d-9179-bb26e2e5692f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:38.555108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78e4fa-b6a5-479d-9179-bb26e2e5692f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:38.555273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78e4fa-b6a5-479d-9179-bb26e2e5692f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:38.572787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-fc78e4fa-b6a5-479d-9179-bb26e2e5692f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:38.573981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-fc78e4fa-b6a5-479d-9179-bb26e2e5692f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:38.637737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 578/1168] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:38.660160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fea2a-373a-4f5c-a1ef-9b3d71cca68e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:38.758091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fea2a-373a-4f5c-a1ef-9b3d71cca68e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:38.789095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89191fe2-abb0-41be-8f76-f1e49eba1256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:38.789754 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89191fe2-abb0-41be-8f76-f1e49eba1256 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:38.790033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89191fe2-abb0-41be-8f76-f1e49eba1256 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:38.790848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89191fe2-abb0-41be-8f76-f1e49eba1256 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:38.791625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89191fe2-abb0-41be-8f76-f1e49eba1256 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:38.792995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89191fe2-abb0-41be-8f76-f1e49eba1256 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:38.812614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 591/1169] 10.222.0.75 () {60 vars in 1138 bytes} [Thu May 12 14:19:38 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:19:41.053341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c4304-4f3d-4d34-b661-d2ba522e2a14 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:41.053893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c4304-4f3d-4d34-b661-d2ba522e2a14 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:41.053893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c4304-4f3d-4d34-b661-d2ba522e2a14 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:41.055316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 579/1170] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:41.061298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa026d7-db15-4e81-9c32-a6d2af9430a8 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:41.061715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa026d7-db15-4e81-9c32-a6d2af9430a8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:41.061847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa026d7-db15-4e81-9c32-a6d2af9430a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:41.078479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-7aa026d7-db15-4e81-9c32-a6d2af9430a8 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:41.079698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7aa026d7-db15-4e81-9c32-a6d2af9430a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:41.147269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 592/1171] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:41.170824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c4304-4f3d-4d34-b661-d2ba522e2a14 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:41.269385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c4304-4f3d-4d34-b661-d2ba522e2a14 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:41.302230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52626e8d-4cd9-403b-96ac-2157a1d3c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:41.303121 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52626e8d-4cd9-403b-96ac-2157a1d3c194 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:41.303405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52626e8d-4cd9-403b-96ac-2157a1d3c194 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:41.303680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52626e8d-4cd9-403b-96ac-2157a1d3c194 None admin] PATH_INFO: `/v3/domains/537d83780c9d4385b6342bae7f681bd0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:41.314631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52626e8d-4cd9-403b-96ac-2157a1d3c194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=537d83780c9d4385b6342bae7f681bd0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:41.316133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52626e8d-4cd9-403b-96ac-2157a1d3c194 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:41.317865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 580/1172] 10.222.0.75 () {56 vars in 1183 bytes} [Thu May 12 14:19:41 2022] GET /identity/v3/domains/537d83780c9d4385b6342bae7f681bd0 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:41.324418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa026d7-db15-4e81-9c32-a6d2af9430a8 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:41.419739 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa026d7-db15-4e81-9c32-a6d2af9430a8 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:41.453680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301e51e-31b5-42c3-bcbb-c7e72e75c30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:41.454339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301e51e-31b5-42c3-bcbb-c7e72e75c30a None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:41.454621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301e51e-31b5-42c3-bcbb-c7e72e75c30a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:41.454896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301e51e-31b5-42c3-bcbb-c7e72e75c30a None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:41.455635 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301e51e-31b5-42c3-bcbb-c7e72e75c30a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:41.457077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301e51e-31b5-42c3-bcbb-c7e72e75c30a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:41.481256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 593/1173] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:19:41 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:19:43.728405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc70b2b-67d4-453d-8ae9-5abba81dd066 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:43.728976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc70b2b-67d4-453d-8ae9-5abba81dd066 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:43.728976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc70b2b-67d4-453d-8ae9-5abba81dd066 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:43.730346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 581/1174] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:43.735964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a61a22-f16d-4cda-98d1-3193eeb7810b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:43.736400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a61a22-f16d-4cda-98d1-3193eeb7810b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:43.736530 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a61a22-f16d-4cda-98d1-3193eeb7810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:43.753783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b9a61a22-f16d-4cda-98d1-3193eeb7810b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:43.754988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b9a61a22-f16d-4cda-98d1-3193eeb7810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:43.841456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 594/1175] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:43.866545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc70b2b-67d4-453d-8ae9-5abba81dd066 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:43.969937 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc70b2b-67d4-453d-8ae9-5abba81dd066 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:44.011079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26733995-114a-4318-8f1e-033ebac00b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:44.011873 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733995-114a-4318-8f1e-033ebac00b87 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:44.012153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733995-114a-4318-8f1e-033ebac00b87 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:44.012430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733995-114a-4318-8f1e-033ebac00b87 None admin] PATH_INFO: `/v3/domains/537d83780c9d4385b6342bae7f681bd0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:44.013636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26733995-114a-4318-8f1e-033ebac00b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=537d83780c9d4385b6342bae7f681bd0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:44.015111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26733995-114a-4318-8f1e-033ebac00b87 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:44.016766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 582/1176] 10.222.0.75 () {56 vars in 1183 bytes} [Thu May 12 14:19:43 2022] GET /identity/v3/domains/537d83780c9d4385b6342bae7f681bd0 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:44.022842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a61a22-f16d-4cda-98d1-3193eeb7810b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:44.125600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a61a22-f16d-4cda-98d1-3193eeb7810b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:44.160064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3476ef5-9a3f-448e-96ba-20be8f7852b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:44.160733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476ef5-9a3f-448e-96ba-20be8f7852b4 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:44.161018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476ef5-9a3f-448e-96ba-20be8f7852b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:44.161302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476ef5-9a3f-448e-96ba-20be8f7852b4 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:44.162016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3476ef5-9a3f-448e-96ba-20be8f7852b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:44.163515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3476ef5-9a3f-448e-96ba-20be8f7852b4 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:44.184488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 595/1177] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:19:44 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:19:46.504487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aa0dd-082e-4dda-a69d-a72b889b91ef None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:46.505025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aa0dd-082e-4dda-a69d-a72b889b91ef None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:46.505025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aa0dd-082e-4dda-a69d-a72b889b91ef None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:46.506409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 583/1178] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:46.512417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55951ab0-b692-421b-8c8c-f98d50faef59 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:46.512854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55951ab0-b692-421b-8c8c-f98d50faef59 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:46.512985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55951ab0-b692-421b-8c8c-f98d50faef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:46.530609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-55951ab0-b692-421b-8c8c-f98d50faef59 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:46.531874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-55951ab0-b692-421b-8c8c-f98d50faef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:46.596905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 596/1179] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:46.622510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aa0dd-082e-4dda-a69d-a72b889b91ef None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:46.724091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aa0dd-082e-4dda-a69d-a72b889b91ef None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:46.757865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a8b52-0fa8-4cd1-baae-dd3a329ff1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:46.758576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a8b52-0fa8-4cd1-baae-dd3a329ff1d5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:46.758887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a8b52-0fa8-4cd1-baae-dd3a329ff1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:46.759190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a8b52-0fa8-4cd1-baae-dd3a329ff1d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:46.769918 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a8b52-0fa8-4cd1-baae-dd3a329ff1d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-045a8b52-0fa8-4cd1-baae-dd3a329ff1d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:19:46.778113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:46.779258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:19:46.780149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 584/1180] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:19:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:46.785983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55951ab0-b692-421b-8c8c-f98d50faef59 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:46.889581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55951ab0-b692-421b-8c8c-f98d50faef59 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:46.925008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca39c4b-d21e-4bdf-8451-dec072069553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:46.925683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca39c4b-d21e-4bdf-8451-dec072069553 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:46.925961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca39c4b-d21e-4bdf-8451-dec072069553 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:46.926233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca39c4b-d21e-4bdf-8451-dec072069553 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:46.926987 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca39c4b-d21e-4bdf-8451-dec072069553 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:46.927334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca39c4b-d21e-4bdf-8451-dec072069553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:46.928737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca39c4b-d21e-4bdf-8451-dec072069553 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:46.937331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 597/1181] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:19:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:46.943201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a8b52-0fa8-4cd1-baae-dd3a329ff1d5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:47.043283 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a8b52-0fa8-4cd1-baae-dd3a329ff1d5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:47.076583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5b21-e47d-4198-83ce-ce590ed6ba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:47.077442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5b21-e47d-4198-83ce-ce590ed6ba32 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:47.077724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5b21-e47d-4198-83ce-ce590ed6ba32 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:47.078000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5b21-e47d-4198-83ce-ce590ed6ba32 None admin] PATH_INFO: `/v3/users/b7587d38f00646ee807ae11b88ae3dae` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:47.092712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde5b21-e47d-4198-83ce-ce590ed6ba32 None admin] RBAC: Authorizing `identity:get_user(user_id=b7587d38f00646ee807ae11b88ae3dae)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:47.094224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde5b21-e47d-4198-83ce-ce590ed6ba32 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:47.095989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 585/1182] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:46 2022] GET /identity/v3/users/b7587d38f00646ee807ae11b88ae3dae => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:47.101720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca39c4b-d21e-4bdf-8451-dec072069553 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:47.204978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca39c4b-d21e-4bdf-8451-dec072069553 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:47.241420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f0edc-c1c1-45d1-aa22-cf3b93c736e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:47.242061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f0edc-c1c1-45d1-aa22-cf3b93c736e8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:47.242342 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f0edc-c1c1-45d1-aa22-cf3b93c736e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:47.242614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f0edc-c1c1-45d1-aa22-cf3b93c736e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:47.307750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f0edc-c1c1-45d1-aa22-cf3b93c736e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:47.309129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f0edc-c1c1-45d1-aa22-cf3b93c736e8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:47.406468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 598/1183] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:19:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:19:47.412598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5b21-e47d-4198-83ce-ce590ed6ba32 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:47.520636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde5b21-e47d-4198-83ce-ce590ed6ba32 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:47.574967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47163f18-b04e-485d-ac47-b21c88d2328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:47.576315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47163f18-b04e-485d-ac47-b21c88d2328a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:47.576765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47163f18-b04e-485d-ac47-b21c88d2328a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:47.577236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47163f18-b04e-485d-ac47-b21c88d2328a None admin] PATH_INFO: `/v3/projects/5f8ccc960a6f40d5affe92e8c13574d5` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:47.579280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47163f18-b04e-485d-ac47-b21c88d2328a None admin] RBAC: Authorizing `identity:get_project(project_id=5f8ccc960a6f40d5affe92e8c13574d5)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:47.581794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47163f18-b04e-485d-ac47-b21c88d2328a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:47.584869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 586/1184] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:47 2022] GET /identity/v3/projects/5f8ccc960a6f40d5affe92e8c13574d5 => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:47.591329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f0edc-c1c1-45d1-aa22-cf3b93c736e8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:47.687954 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f0edc-c1c1-45d1-aa22-cf3b93c736e8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:47.720765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88d977-e964-4f69-a8ff-c2cd7e841c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:47.721411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88d977-e964-4f69-a8ff-c2cd7e841c06 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:47.721692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88d977-e964-4f69-a8ff-c2cd7e841c06 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:47.721965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88d977-e964-4f69-a8ff-c2cd7e841c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:47.722783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88d977-e964-4f69-a8ff-c2cd7e841c06 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=5f8ccc960a6f40d5affe92e8c13574d5, user.id=b7587d38f00646ee807ae11b88ae3dae) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:47.723118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88d977-e964-4f69-a8ff-c2cd7e841c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:47.724550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88d977-e964-4f69-a8ff-c2cd7e841c06 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:47.730685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 599/1185] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:19:47 2022] GET /identity/v3/role_assignments?user.id=b7587d38f00646ee807ae11b88ae3dae&scope.project.id=5f8ccc960a6f40d5affe92e8c13574d5&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:49.929327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea7505-9bff-4ae5-bf0e-2f0952d3ebaf None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:49.929864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea7505-9bff-4ae5-bf0e-2f0952d3ebaf None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:49.929864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea7505-9bff-4ae5-bf0e-2f0952d3ebaf None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:49.931268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 587/1186] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:49.936323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf73b3f-4b8d-449f-80b8-1ce2fa4e8501 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:49.936769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf73b3f-4b8d-449f-80b8-1ce2fa4e8501 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:49.936885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf73b3f-4b8d-449f-80b8-1ce2fa4e8501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:49.956482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-cdf73b3f-4b8d-449f-80b8-1ce2fa4e8501 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:49.957684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cdf73b3f-4b8d-449f-80b8-1ce2fa4e8501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:50.026774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 600/1187] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:19:50.048535 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea7505-9bff-4ae5-bf0e-2f0952d3ebaf None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:50.143668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea7505-9bff-4ae5-bf0e-2f0952d3ebaf None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:50.174819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8da797-9f28-4964-a290-13e90229f77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:50.175611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da797-9f28-4964-a290-13e90229f77a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:50.175888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da797-9f28-4964-a290-13e90229f77a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:50.176154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da797-9f28-4964-a290-13e90229f77a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:50.185692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8da797-9f28-4964-a290-13e90229f77a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-8c8da797-9f28-4964-a290-13e90229f77a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:19:50.193130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:50.194226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:19:50.200515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 588/1188] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:19:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:50.201368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf73b3f-4b8d-449f-80b8-1ce2fa4e8501 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:50.297445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf73b3f-4b8d-449f-80b8-1ce2fa4e8501 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:50.331254 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920c4fd-ff91-4541-abf5-98f4b25b536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:50.331913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920c4fd-ff91-4541-abf5-98f4b25b536f None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:50.332193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920c4fd-ff91-4541-abf5-98f4b25b536f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:50.332466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920c4fd-ff91-4541-abf5-98f4b25b536f None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:50.333200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920c4fd-ff91-4541-abf5-98f4b25b536f None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:50.333505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920c4fd-ff91-4541-abf5-98f4b25b536f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:50.334876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920c4fd-ff91-4541-abf5-98f4b25b536f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:50.343018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 601/1189] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:19:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:50.348962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8da797-9f28-4964-a290-13e90229f77a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:50.443004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8da797-9f28-4964-a290-13e90229f77a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:50.474420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aea235-c1bb-4cfe-8f94-b07f5d164ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:50.475295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aea235-c1bb-4cfe-8f94-b07f5d164ff8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:50.475581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aea235-c1bb-4cfe-8f94-b07f5d164ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:50.475855 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aea235-c1bb-4cfe-8f94-b07f5d164ff8 None admin] PATH_INFO: `/v3/users/b7587d38f00646ee807ae11b88ae3dae` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:50.477045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aea235-c1bb-4cfe-8f94-b07f5d164ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=b7587d38f00646ee807ae11b88ae3dae)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:50.478491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aea235-c1bb-4cfe-8f94-b07f5d164ff8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:50.481052 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 589/1190] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:50 2022] GET /identity/v3/users/b7587d38f00646ee807ae11b88ae3dae => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:50.486640 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920c4fd-ff91-4541-abf5-98f4b25b536f None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:50.582129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920c4fd-ff91-4541-abf5-98f4b25b536f None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:50.613201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4c996-bd1a-429e-a257-fbfa444c1654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:50.614064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c996-bd1a-429e-a257-fbfa444c1654 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:50.614346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c996-bd1a-429e-a257-fbfa444c1654 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:50.614620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4c996-bd1a-429e-a257-fbfa444c1654 None admin] PATH_INFO: `/v3/projects/5f8ccc960a6f40d5affe92e8c13574d5` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:50.615857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4c996-bd1a-429e-a257-fbfa444c1654 None admin] RBAC: Authorizing `identity:get_project(project_id=5f8ccc960a6f40d5affe92e8c13574d5)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:50.617302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4c996-bd1a-429e-a257-fbfa444c1654 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:50.619595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 602/1191] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:50 2022] GET /identity/v3/projects/5f8ccc960a6f40d5affe92e8c13574d5 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:50.627284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aea235-c1bb-4cfe-8f94-b07f5d164ff8 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:50.731649 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aea235-c1bb-4cfe-8f94-b07f5d164ff8 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:50.762794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506bb04-350c-47f4-be20-fd5d062e4213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:50.763842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506bb04-350c-47f4-be20-fd5d062e4213 None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:50.764121 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506bb04-350c-47f4-be20-fd5d062e4213 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:50.764390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506bb04-350c-47f4-be20-fd5d062e4213 None admin] PATH_INFO: `/v3/projects/5f8ccc960a6f40d5affe92e8c13574d5/users/b7587d38f00646ee807ae11b88ae3dae/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:50.766308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506bb04-350c-47f4-be20-fd5d062e4213 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f8ccc960a6f40d5affe92e8c13574d5, user_id=b7587d38f00646ee807ae11b88ae3dae, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:50.767745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506bb04-350c-47f4-be20-fd5d062e4213 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:50.781140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 590/1192] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:19:50 2022] PUT /identity/v3/projects/5f8ccc960a6f40d5affe92e8c13574d5/users/b7587d38f00646ee807ae11b88ae3dae/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:19:52.979201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43635-9262-4300-80ec-8d407b067bd9 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:52.979852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43635-9262-4300-80ec-8d407b067bd9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:52.979852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43635-9262-4300-80ec-8d407b067bd9 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:52.981141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 603/1193] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:19:52.986364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e70ab-28c4-4da6-9873-887a6936d345 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:52.986790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e70ab-28c4-4da6-9873-887a6936d345 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:52.986927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e70ab-28c4-4da6-9873-887a6936d345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:53.003880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-669e70ab-28c4-4da6-9873-887a6936d345 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:19:53.005074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-669e70ab-28c4-4da6-9873-887a6936d345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:19:53.070393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 591/1194] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:19:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:19:53.093413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db43635-9262-4300-80ec-8d407b067bd9 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:53.191240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db43635-9262-4300-80ec-8d407b067bd9 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:53.222553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400e96-61ca-4274-92ca-207662346996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:53.223285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400e96-61ca-4274-92ca-207662346996 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:53.223566 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400e96-61ca-4274-92ca-207662346996 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:53.223836 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400e96-61ca-4274-92ca-207662346996 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:53.233898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d400e96-61ca-4274-92ca-207662346996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-8d400e96-61ca-4274-92ca-207662346996 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:19:53.241374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:19:53.242418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:19:53.244141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 604/1195] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:19:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:19:53.249200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e70ab-28c4-4da6-9873-887a6936d345 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:53.340993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e70ab-28c4-4da6-9873-887a6936d345 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:53.373199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e999-9ae9-4a08-9f64-3db35e6a16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:53.373856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e999-9ae9-4a08-9f64-3db35e6a16be None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:53.374136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e999-9ae9-4a08-9f64-3db35e6a16be None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:53.374407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f083e999-9ae9-4a08-9f64-3db35e6a16be None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:53.375173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e999-9ae9-4a08-9f64-3db35e6a16be None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:53.375476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e999-9ae9-4a08-9f64-3db35e6a16be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:53.376835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f083e999-9ae9-4a08-9f64-3db35e6a16be None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:53.384647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 592/1196] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:19:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:53.390447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400e96-61ca-4274-92ca-207662346996 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:53.510662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400e96-61ca-4274-92ca-207662346996 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:53.543551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654bfab-1a54-4f4e-a3d8-57c0e470c479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:53.544415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654bfab-1a54-4f4e-a3d8-57c0e470c479 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:53.544701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654bfab-1a54-4f4e-a3d8-57c0e470c479 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:53.544972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654bfab-1a54-4f4e-a3d8-57c0e470c479 None admin] PATH_INFO: `/v3/users/b7587d38f00646ee807ae11b88ae3dae` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:53.546148 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654bfab-1a54-4f4e-a3d8-57c0e470c479 None admin] RBAC: Authorizing `identity:get_user(user_id=b7587d38f00646ee807ae11b88ae3dae)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:53.548110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654bfab-1a54-4f4e-a3d8-57c0e470c479 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:53.549766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 605/1197] 10.222.0.75 () {56 vars in 1177 bytes} [Thu May 12 14:19:53 2022] GET /identity/v3/users/b7587d38f00646ee807ae11b88ae3dae => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:53.555606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e999-9ae9-4a08-9f64-3db35e6a16be None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:53.658746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f083e999-9ae9-4a08-9f64-3db35e6a16be None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:53.690704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0a1e-c2db-487e-aa49-43afe671dcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:53.691377 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0a1e-c2db-487e-aa49-43afe671dcaf None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:53.691659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0a1e-c2db-487e-aa49-43afe671dcaf None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:53.691932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0a1e-c2db-487e-aa49-43afe671dcaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:53.754789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc0a1e-c2db-487e-aa49-43afe671dcaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:53.756255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc0a1e-c2db-487e-aa49-43afe671dcaf None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:53.849519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 593/1198] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:19:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:19:53.855504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654bfab-1a54-4f4e-a3d8-57c0e470c479 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:53.956857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654bfab-1a54-4f4e-a3d8-57c0e470c479 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:53.990488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7594d57-daf4-49cc-9588-17123035c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:53.991381 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7594d57-daf4-49cc-9588-17123035c027 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:53.991664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7594d57-daf4-49cc-9588-17123035c027 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:53.991942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7594d57-daf4-49cc-9588-17123035c027 None admin] PATH_INFO: `/v3/projects/5f8ccc960a6f40d5affe92e8c13574d5` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:53.993166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7594d57-daf4-49cc-9588-17123035c027 None admin] RBAC: Authorizing `identity:get_project(project_id=5f8ccc960a6f40d5affe92e8c13574d5)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:53.994614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7594d57-daf4-49cc-9588-17123035c027 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:53.996375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 606/1199] 10.222.0.75 () {56 vars in 1186 bytes} [Thu May 12 14:19:53 2022] GET /identity/v3/projects/5f8ccc960a6f40d5affe92e8c13574d5 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:19:54.002760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0a1e-c2db-487e-aa49-43afe671dcaf None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:19:54.114370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0a1e-c2db-487e-aa49-43afe671dcaf None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:19:54.147945 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab14d5-40d2-444c-94c5-356433efa2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:19:54.148609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab14d5-40d2-444c-94c5-356433efa2b4 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:19:54.149443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab14d5-40d2-444c-94c5-356433efa2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:19:54.149735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab14d5-40d2-444c-94c5-356433efa2b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:19:54.150575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab14d5-40d2-444c-94c5-356433efa2b4 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=5f8ccc960a6f40d5affe92e8c13574d5, user.id=b7587d38f00646ee807ae11b88ae3dae) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:19:54.150889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab14d5-40d2-444c-94c5-356433efa2b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:19:54.152353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab14d5-40d2-444c-94c5-356433efa2b4 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:19:54.158238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 594/1200] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:19:54 2022] GET /identity/v3/role_assignments?user.id=b7587d38f00646ee807ae11b88ae3dae&scope.project.id=5f8ccc960a6f40d5affe92e8c13574d5&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:20:56.059157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3292a0d-f554-4de7-a9f0-6add22c30c23 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:20:56.059735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3292a0d-f554-4de7-a9f0-6add22c30c23 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:20:56.059735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3292a0d-f554-4de7-a9f0-6add22c30c23 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:20:56.061422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 607/1201] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:20:56.067425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5759e-e27c-4f32-9f54-704f0e815b54 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:20:56.068501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5759e-e27c-4f32-9f54-704f0e815b54 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:20:56.068501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5759e-e27c-4f32-9f54-704f0e815b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:20:56.088306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-95b5759e-e27c-4f32-9f54-704f0e815b54 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:20:56.089504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-95b5759e-e27c-4f32-9f54-704f0e815b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:20:56.179360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 595/1202] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:20:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:20:56.212720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3292a0d-f554-4de7-a9f0-6add22c30c23 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:20:56.342987 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3292a0d-f554-4de7-a9f0-6add22c30c23 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:20:56.387903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042f21a-2a32-49be-8c09-d41cab1c7557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:20:56.388751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042f21a-2a32-49be-8c09-d41cab1c7557 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:20:56.389039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042f21a-2a32-49be-8c09-d41cab1c7557 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:20:56.389459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042f21a-2a32-49be-8c09-d41cab1c7557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:20:56.410780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042f21a-2a32-49be-8c09-d41cab1c7557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:20:56.411299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042f21a-2a32-49be-8c09-d41cab1c7557 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-7042f21a-2a32-49be-8c09-d41cab1c7557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:20:56.432486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:20:56.433802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:20:56.435135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:20:56.435135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:20:56.435135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:20:56.435135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:20:56.435135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 608/1203] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:20:56.440569 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5759e-e27c-4f32-9f54-704f0e815b54 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:20:56.576977 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5759e-e27c-4f32-9f54-704f0e815b54 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:20:56.621376 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32390293-9052-433c-850f-708233f2347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:20:56.622171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390293-9052-433c-850f-708233f2347d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:20:56.622598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390293-9052-433c-850f-708233f2347d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:20:56.622888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390293-9052-433c-850f-708233f2347d None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:20:56.624018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32390293-9052-433c-850f-708233f2347d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:20:56.624488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32390293-9052-433c-850f-708233f2347d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:20:56.626140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32390293-9052-433c-850f-708233f2347d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:20:56.646068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 596/1204] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:20:56.647315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042f21a-2a32-49be-8c09-d41cab1c7557 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:20:56.780512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042f21a-2a32-49be-8c09-d41cab1c7557 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:20:56.832703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62cbff-7bc1-4643-93b0-d3cf33bc8066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:20:56.833528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62cbff-7bc1-4643-93b0-d3cf33bc8066 None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:20:56.833851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62cbff-7bc1-4643-93b0-d3cf33bc8066 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:20:56.834155 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62cbff-7bc1-4643-93b0-d3cf33bc8066 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:20:56.834891 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62cbff-7bc1-4643-93b0-d3cf33bc8066 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:20:56.836470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62cbff-7bc1-4643-93b0-d3cf33bc8066 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:20:56.869743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 609/1205] 10.222.0.75 () {60 vars in 1132 bytes} [Thu May 12 14:20:56 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:20:59.598054 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733c3b7-41ca-4683-b71f-04ed9feed504 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:20:59.599671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733c3b7-41ca-4683-b71f-04ed9feed504 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:20:59.599671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733c3b7-41ca-4683-b71f-04ed9feed504 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:20:59.600596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 597/1206] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:20:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:20:59.606638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce52323-d35d-4ab0-a749-3d9a833a9223 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:20:59.608689 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce52323-d35d-4ab0-a749-3d9a833a9223 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:20:59.608689 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce52323-d35d-4ab0-a749-3d9a833a9223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:20:59.625833 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6ce52323-d35d-4ab0-a749-3d9a833a9223 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:20:59.627111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6ce52323-d35d-4ab0-a749-3d9a833a9223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:20:59.703688 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 610/1207] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:20:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:20:59.732034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733c3b7-41ca-4683-b71f-04ed9feed504 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:20:59.852587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733c3b7-41ca-4683-b71f-04ed9feed504 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:20:59.893703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b273b6b-2211-402c-87f6-38bc36e6adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:20:59.894583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273b6b-2211-402c-87f6-38bc36e6adfe None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:20:59.894941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273b6b-2211-402c-87f6-38bc36e6adfe None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:20:59.895327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b273b6b-2211-402c-87f6-38bc36e6adfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:20:59.907230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b273b6b-2211-402c-87f6-38bc36e6adfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-4b273b6b-2211-402c-87f6-38bc36e6adfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:20:59.915793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:20:59.917081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:20:59.917952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 598/1208] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:20:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:20:59.924325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce52323-d35d-4ab0-a749-3d9a833a9223 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:00.044260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce52323-d35d-4ab0-a749-3d9a833a9223 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:00.082900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b12d39-b413-4c02-91b0-75f74dbe6483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:00.083776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b12d39-b413-4c02-91b0-75f74dbe6483 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:00.084006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b12d39-b413-4c02-91b0-75f74dbe6483 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:00.084328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b12d39-b413-4c02-91b0-75f74dbe6483 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:00.085139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b12d39-b413-4c02-91b0-75f74dbe6483 None admin] RBAC: Adding query filter params (name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:00.085457 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b12d39-b413-4c02-91b0-75f74dbe6483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:00.086887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b12d39-b413-4c02-91b0-75f74dbe6483 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:00.095723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 611/1209] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:20:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:00.106135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b273b6b-2211-402c-87f6-38bc36e6adfe None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:00.216752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b273b6b-2211-402c-87f6-38bc36e6adfe None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:00.254165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1f57f-a2d5-4e0b-8286-242fedcccbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:00.254973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1f57f-a2d5-4e0b-8286-242fedcccbc9 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:00.255321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1f57f-a2d5-4e0b-8286-242fedcccbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:00.256109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1f57f-a2d5-4e0b-8286-242fedcccbc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:00.267914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1f57f-a2d5-4e0b-8286-242fedcccbc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:00.269392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1f57f-a2d5-4e0b-8286-242fedcccbc9 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-5bf1f57f-a2d5-4e0b-8286-242fedcccbc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:00.287599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:00.294617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:00.295808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:00.295808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:00.295808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:00.295808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:00.295808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 599/1210] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:21:00.297803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b12d39-b413-4c02-91b0-75f74dbe6483 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:00.430317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b12d39-b413-4c02-91b0-75f74dbe6483 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:00.470409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d33ce-5c59-497a-b640-4a559cd8f335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:00.471132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d33ce-5c59-497a-b640-4a559cd8f335 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:00.471467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d33ce-5c59-497a-b640-4a559cd8f335 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:00.471771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d33ce-5c59-497a-b640-4a559cd8f335 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:00.472526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d33ce-5c59-497a-b640-4a559cd8f335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:00.472895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d33ce-5c59-497a-b640-4a559cd8f335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:00.474310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d33ce-5c59-497a-b640-4a559cd8f335 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:00.488032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 612/1211] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:00.495248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1f57f-a2d5-4e0b-8286-242fedcccbc9 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:00.629199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1f57f-a2d5-4e0b-8286-242fedcccbc9 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:00.667265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bce02-3d8a-4342-8c82-d92158ffb59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:00.668327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bce02-3d8a-4342-8c82-d92158ffb59a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:00.668855 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bce02-3d8a-4342-8c82-d92158ffb59a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:00.669217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bce02-3d8a-4342-8c82-d92158ffb59a None admin] PATH_INFO: `/v3/users/placement` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:00.678350 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bce02-3d8a-4342-8c82-d92158ffb59a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:00.679994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839bce02-3d8a-4342-8c82-d92158ffb59a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-839bce02-3d8a-4342-8c82-d92158ffb59a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:21:00.696239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:00.697398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:00.698441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 600/1212] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:00.703639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d33ce-5c59-497a-b640-4a559cd8f335 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:00.816088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d33ce-5c59-497a-b640-4a559cd8f335 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:00.853634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f629e6-f490-42ae-842b-f847292266e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:00.854571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f629e6-f490-42ae-842b-f847292266e3 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:00.854826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f629e6-f490-42ae-842b-f847292266e3 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:00.855145 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f629e6-f490-42ae-842b-f847292266e3 None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:00.856037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f629e6-f490-42ae-842b-f847292266e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:00.856399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f629e6-f490-42ae-842b-f847292266e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:00.858094 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f629e6-f490-42ae-842b-f847292266e3 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:00.881798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 613/1213] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 12 14:21:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:00.893983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bce02-3d8a-4342-8c82-d92158ffb59a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:01.029364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bce02-3d8a-4342-8c82-d92158ffb59a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:01.075297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2674e88-6856-49fa-938b-ecf32f1927af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:01.076381 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2674e88-6856-49fa-938b-ecf32f1927af None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:01.076879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2674e88-6856-49fa-938b-ecf32f1927af None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:01.077324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2674e88-6856-49fa-938b-ecf32f1927af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:01.152665 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2674e88-6856-49fa-938b-ecf32f1927af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:01.154223 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2674e88-6856-49fa-938b-ecf32f1927af None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:01.276969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 601/1214] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:21:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:21:01.283137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f629e6-f490-42ae-842b-f847292266e3 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:01.399612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f629e6-f490-42ae-842b-f847292266e3 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:01.438456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378a5b-b5f6-4f69-b0a6-4a8b46dcd14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:01.439346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378a5b-b5f6-4f69-b0a6-4a8b46dcd14a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:01.439653 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378a5b-b5f6-4f69-b0a6-4a8b46dcd14a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:01.439955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8378a5b-b5f6-4f69-b0a6-4a8b46dcd14a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:01.454224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8378a5b-b5f6-4f69-b0a6-4a8b46dcd14a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:01.454224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8378a5b-b5f6-4f69-b0a6-4a8b46dcd14a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-a8378a5b-b5f6-4f69-b0a6-4a8b46dcd14a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:01.474690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:01.476160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:01.477554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:01.477554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:01.477554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:01.477554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:01.479487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 614/1215] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:01.485294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2674e88-6856-49fa-938b-ecf32f1927af None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:01.603081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2674e88-6856-49fa-938b-ecf32f1927af None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:01.647640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa77a5e-4fc4-444a-8dd8-f4f844d1b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:01.648597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa77a5e-4fc4-444a-8dd8-f4f844d1b62e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:01.648597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa77a5e-4fc4-444a-8dd8-f4f844d1b62e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:01.651073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa77a5e-4fc4-444a-8dd8-f4f844d1b62e None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:01.651073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa77a5e-4fc4-444a-8dd8-f4f844d1b62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:01.651073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa77a5e-4fc4-444a-8dd8-f4f844d1b62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:01.651466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa77a5e-4fc4-444a-8dd8-f4f844d1b62e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:01.663870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 602/1216] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:01.669806 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378a5b-b5f6-4f69-b0a6-4a8b46dcd14a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:01.784255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8378a5b-b5f6-4f69-b0a6-4a8b46dcd14a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:01.830065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d882685-9676-4a4c-8b20-52b171a833d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:01.830884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d882685-9676-4a4c-8b20-52b171a833d4 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:01.831991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d882685-9676-4a4c-8b20-52b171a833d4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:01.831991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d882685-9676-4a4c-8b20-52b171a833d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:01.842709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d882685-9676-4a4c-8b20-52b171a833d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:01.844634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d882685-9676-4a4c-8b20-52b171a833d4 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-2d882685-9676-4a4c-8b20-52b171a833d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:21:01.862079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:01.863128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:01.864062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:21:01.864062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:21:01.864062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:21:01.864062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:21:01.864062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:21:01.864062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:21:01.864062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:01.864062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:01.864062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 615/1217] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:21:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:01.871186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa77a5e-4fc4-444a-8dd8-f4f844d1b62e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:01.995739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa77a5e-4fc4-444a-8dd8-f4f844d1b62e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:02.034210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81528725-66ac-4403-9078-518010282f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:02.035193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528725-66ac-4403-9078-518010282f69 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:02.035609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528725-66ac-4403-9078-518010282f69 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:02.035961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81528725-66ac-4403-9078-518010282f69 None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:02.037471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81528725-66ac-4403-9078-518010282f69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:02.037962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81528725-66ac-4403-9078-518010282f69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:02.039563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81528725-66ac-4403-9078-518010282f69 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:02.054203 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 603/1218] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:21:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:21:02.059301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d882685-9676-4a4c-8b20-52b171a833d4 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:02.169796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d882685-9676-4a4c-8b20-52b171a833d4 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:02.209620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0b69c-e506-4107-b5f5-382e8f6a2c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:02.210281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b69c-e506-4107-b5f5-382e8f6a2c2b None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:02.210619 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b69c-e506-4107-b5f5-382e8f6a2c2b None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:02.210853 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b69c-e506-4107-b5f5-382e8f6a2c2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:02.211789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0b69c-e506-4107-b5f5-382e8f6a2c2b None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=3004f3e4a9854502be59119e17e04961) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:02.212126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0b69c-e506-4107-b5f5-382e8f6a2c2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:02.213641 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0b69c-e506-4107-b5f5-382e8f6a2c2b None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:02.220347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 616/1219] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:21:02 2022] GET /identity/v3/role_assignments?user.id=3004f3e4a9854502be59119e17e04961&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:04.499264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908dcf7-f04e-4383-88be-6d4c9b77705a None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:04.499822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908dcf7-f04e-4383-88be-6d4c9b77705a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:04.499822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908dcf7-f04e-4383-88be-6d4c9b77705a None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:04.501190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 604/1220] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:21:04.508256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cf74d-c14d-4902-bbd8-fb30ea4e0990 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:04.508890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cf74d-c14d-4902-bbd8-fb30ea4e0990 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:04.509426 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cf74d-c14d-4902-bbd8-fb30ea4e0990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:04.530941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-df7cf74d-c14d-4902-bbd8-fb30ea4e0990 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:21:04.532181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-df7cf74d-c14d-4902-bbd8-fb30ea4e0990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:21:04.609436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 617/1221] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:21:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:21:04.634749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908dcf7-f04e-4383-88be-6d4c9b77705a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:04.772918 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908dcf7-f04e-4383-88be-6d4c9b77705a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:04.822917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f899288-ce37-42f7-993a-ce1bb63cb056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:04.823800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f899288-ce37-42f7-993a-ce1bb63cb056 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:04.824082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f899288-ce37-42f7-993a-ce1bb63cb056 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:04.824351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f899288-ce37-42f7-993a-ce1bb63cb056 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:04.838255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f899288-ce37-42f7-993a-ce1bb63cb056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-7f899288-ce37-42f7-993a-ce1bb63cb056 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:21:04.846383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:04.847726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:04.848752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 605/1222] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:21:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:04.853878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cf74d-c14d-4902-bbd8-fb30ea4e0990 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:04.967585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cf74d-c14d-4902-bbd8-fb30ea4e0990 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:05.004387 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c6fcc-a1f9-45c8-b922-6c35c2e0a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:05.005610 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c6fcc-a1f9-45c8-b922-6c35c2e0a142 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:05.005891 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c6fcc-a1f9-45c8-b922-6c35c2e0a142 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:05.006163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c6fcc-a1f9-45c8-b922-6c35c2e0a142 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:05.006936 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c6fcc-a1f9-45c8-b922-6c35c2e0a142 None admin] RBAC: Adding query filter params (name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:05.007342 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c6fcc-a1f9-45c8-b922-6c35c2e0a142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:05.008719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c6fcc-a1f9-45c8-b922-6c35c2e0a142 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:05.017149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 618/1223] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:21:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:05.023739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f899288-ce37-42f7-993a-ce1bb63cb056 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:05.125958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f899288-ce37-42f7-993a-ce1bb63cb056 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:05.161648 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be85ce5-432e-4278-98d5-2017ee3ddb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:05.162443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be85ce5-432e-4278-98d5-2017ee3ddb9f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:05.162726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be85ce5-432e-4278-98d5-2017ee3ddb9f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:05.162999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be85ce5-432e-4278-98d5-2017ee3ddb9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:05.174129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be85ce5-432e-4278-98d5-2017ee3ddb9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:05.175616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be85ce5-432e-4278-98d5-2017ee3ddb9f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-7be85ce5-432e-4278-98d5-2017ee3ddb9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:05.193425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:05.194618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:05.195661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:05.195661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:05.195661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:05.195661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:05.199312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 606/1224] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:05.200413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c6fcc-a1f9-45c8-b922-6c35c2e0a142 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:05.307320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c6fcc-a1f9-45c8-b922-6c35c2e0a142 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:05.342324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3632979-e0b8-4b2a-b7c0-275125e4d737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:05.342991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3632979-e0b8-4b2a-b7c0-275125e4d737 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:05.343308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3632979-e0b8-4b2a-b7c0-275125e4d737 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:05.343581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3632979-e0b8-4b2a-b7c0-275125e4d737 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:05.344303 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3632979-e0b8-4b2a-b7c0-275125e4d737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:05.344609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3632979-e0b8-4b2a-b7c0-275125e4d737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:05.345997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3632979-e0b8-4b2a-b7c0-275125e4d737 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:05.357674 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 619/1225] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:05.363403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be85ce5-432e-4278-98d5-2017ee3ddb9f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:05.466541 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be85ce5-432e-4278-98d5-2017ee3ddb9f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:05.498893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d901ed-351f-411d-88be-a97af6e3682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:05.499728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d901ed-351f-411d-88be-a97af6e3682c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:05.500288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d901ed-351f-411d-88be-a97af6e3682c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:05.500288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d901ed-351f-411d-88be-a97af6e3682c None admin] PATH_INFO: `/v3/users/placement` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:05.508506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d901ed-351f-411d-88be-a97af6e3682c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:05.510344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d901ed-351f-411d-88be-a97af6e3682c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-96d901ed-351f-411d-88be-a97af6e3682c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:21:05.527753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:05.528968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:05.529933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 607/1226] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:05.535321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3632979-e0b8-4b2a-b7c0-275125e4d737 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:05.646749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3632979-e0b8-4b2a-b7c0-275125e4d737 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:05.680598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a3eee-75c2-4bc3-9927-37ec75ece22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:05.681277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3eee-75c2-4bc3-9927-37ec75ece22c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:05.681555 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3eee-75c2-4bc3-9927-37ec75ece22c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:05.681824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3eee-75c2-4bc3-9927-37ec75ece22c None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:05.682670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a3eee-75c2-4bc3-9927-37ec75ece22c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:05.682975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a3eee-75c2-4bc3-9927-37ec75ece22c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:05.684456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a3eee-75c2-4bc3-9927-37ec75ece22c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:05.709245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 620/1227] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 12 14:21:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:21:05.714942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d901ed-351f-411d-88be-a97af6e3682c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:05.845964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d901ed-351f-411d-88be-a97af6e3682c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:05.895043 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3dbc0-60e4-4c2a-8ddf-4de145dda53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:05.896189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3dbc0-60e4-4c2a-8ddf-4de145dda53b None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:05.896516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3dbc0-60e4-4c2a-8ddf-4de145dda53b None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:05.896947 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3dbc0-60e4-4c2a-8ddf-4de145dda53b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:05.910049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3dbc0-60e4-4c2a-8ddf-4de145dda53b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:05.912337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3dbc0-60e4-4c2a-8ddf-4de145dda53b None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-d5e3dbc0-60e4-4c2a-8ddf-4de145dda53b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:05.935144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:05.936653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:05.937816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:05.937816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:05.937816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:05.937816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:05.937816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 608/1228] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:05.945022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a3eee-75c2-4bc3-9927-37ec75ece22c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:06.059419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a3eee-75c2-4bc3-9927-37ec75ece22c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:06.102797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e37c-0639-4003-9d26-9f08b171f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:06.103811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e37c-0639-4003-9d26-9f08b171f24a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:06.104236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e37c-0639-4003-9d26-9f08b171f24a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:06.104648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692e37c-0639-4003-9d26-9f08b171f24a None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:06.105764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e37c-0639-4003-9d26-9f08b171f24a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:06.106227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e37c-0639-4003-9d26-9f08b171f24a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:06.108566 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692e37c-0639-4003-9d26-9f08b171f24a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:06.123706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 621/1229] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:06.131707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3dbc0-60e4-4c2a-8ddf-4de145dda53b None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:06.240659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3dbc0-60e4-4c2a-8ddf-4de145dda53b None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:06.277027 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57730b47-299f-45c2-86a9-2deda0f22896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:06.277922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57730b47-299f-45c2-86a9-2deda0f22896 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:06.278267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57730b47-299f-45c2-86a9-2deda0f22896 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:06.278563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57730b47-299f-45c2-86a9-2deda0f22896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:06.286754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57730b47-299f-45c2-86a9-2deda0f22896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:06.288247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57730b47-299f-45c2-86a9-2deda0f22896 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-57730b47-299f-45c2-86a9-2deda0f22896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:21:06.306464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:06.307721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:06.308868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:21:06.308868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:21:06.308868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:21:06.308868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:21:06.308868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:21:06.308868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:21:06.308868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:06.308868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:06.308868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 609/1230] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:21:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:06.315190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e37c-0639-4003-9d26-9f08b171f24a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:06.432200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692e37c-0639-4003-9d26-9f08b171f24a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:06.468864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20309b-12c1-4eae-8900-fadbf84cbad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:06.469576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20309b-12c1-4eae-8900-fadbf84cbad8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:06.469862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20309b-12c1-4eae-8900-fadbf84cbad8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:06.470166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20309b-12c1-4eae-8900-fadbf84cbad8 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:06.470942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20309b-12c1-4eae-8900-fadbf84cbad8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:06.471300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20309b-12c1-4eae-8900-fadbf84cbad8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:06.472753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20309b-12c1-4eae-8900-fadbf84cbad8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:06.485923 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 622/1231] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:21:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:06.492301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57730b47-299f-45c2-86a9-2deda0f22896 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:06.598872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57730b47-299f-45c2-86a9-2deda0f22896 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:06.636193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd520a-770f-470c-a934-b8f5a2228f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:06.637096 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd520a-770f-470c-a934-b8f5a2228f6c None admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:06.637441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd520a-770f-470c-a934-b8f5a2228f6c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:06.637732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd520a-770f-470c-a934-b8f5a2228f6c None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/3004f3e4a9854502be59119e17e04961/roles/74e0a16c92f749e793a06bd6cbb9b2b6` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:06.654700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd520a-770f-470c-a934-b8f5a2228f6c None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=3004f3e4a9854502be59119e17e04961, role_id=74e0a16c92f749e793a06bd6cbb9b2b6)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:06.656198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd520a-770f-470c-a934-b8f5a2228f6c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:06.670426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 610/1232] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:21:06 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/3004f3e4a9854502be59119e17e04961/roles/74e0a16c92f749e793a06bd6cbb9b2b6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:21:09.029692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dddb9-066c-4d0f-a46a-7467e53549ac None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:09.030245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dddb9-066c-4d0f-a46a-7467e53549ac None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:09.030245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dddb9-066c-4d0f-a46a-7467e53549ac None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:09.031781 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 623/1233] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:21:09.039154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25262c24-ead1-4639-b465-87a0d4d60a53 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:09.039652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25262c24-ead1-4639-b465-87a0d4d60a53 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:09.039762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25262c24-ead1-4639-b465-87a0d4d60a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:09.056984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-25262c24-ead1-4639-b465-87a0d4d60a53 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:21:09.058256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-25262c24-ead1-4639-b465-87a0d4d60a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:21:09.130016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 611/1234] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:21:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:21:09.155582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dddb9-066c-4d0f-a46a-7467e53549ac None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:09.272258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dddb9-066c-4d0f-a46a-7467e53549ac None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:09.306156 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fe9de-0bef-4475-9057-64f860eeb7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:09.306995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fe9de-0bef-4475-9057-64f860eeb7b3 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:09.307340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fe9de-0bef-4475-9057-64f860eeb7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:09.307613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144fe9de-0bef-4475-9057-64f860eeb7b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:09.318503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144fe9de-0bef-4475-9057-64f860eeb7b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-144fe9de-0bef-4475-9057-64f860eeb7b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:21:09.326767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:09.328304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:09.329488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 624/1235] 10.222.0.75 () {56 vars in 1102 bytes} [Thu May 12 14:21:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:09.335114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25262c24-ead1-4639-b465-87a0d4d60a53 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:09.436027 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25262c24-ead1-4639-b465-87a0d4d60a53 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:09.471811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ada2e-6d50-45f3-af1e-283cc8eb0086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:09.472811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ada2e-6d50-45f3-af1e-283cc8eb0086 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:09.473123 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ada2e-6d50-45f3-af1e-283cc8eb0086 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:09.473407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ada2e-6d50-45f3-af1e-283cc8eb0086 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:09.475545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ada2e-6d50-45f3-af1e-283cc8eb0086 None admin] RBAC: Adding query filter params (name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:09.475545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ada2e-6d50-45f3-af1e-283cc8eb0086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:09.476942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ada2e-6d50-45f3-af1e-283cc8eb0086 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:09.486518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 612/1236] 10.222.0.75 () {56 vars in 1103 bytes} [Thu May 12 14:21:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:09.493199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fe9de-0bef-4475-9057-64f860eeb7b3 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:09.596145 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144fe9de-0bef-4475-9057-64f860eeb7b3 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:09.635748 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c90e-b4b0-4f9d-bfa9-9178fc359062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:09.636650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c90e-b4b0-4f9d-bfa9-9178fc359062 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:09.636928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c90e-b4b0-4f9d-bfa9-9178fc359062 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:09.637270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c90e-b4b0-4f9d-bfa9-9178fc359062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:09.649341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7c90e-b4b0-4f9d-bfa9-9178fc359062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:09.650701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7c90e-b4b0-4f9d-bfa9-9178fc359062 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-65e7c90e-b4b0-4f9d-bfa9-9178fc359062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:09.670055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:09.672438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:09.673733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:09.673733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:09.673733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:09.673733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:09.673733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 625/1237] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 12 14:21:09.678490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ada2e-6d50-45f3-af1e-283cc8eb0086 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:09.795715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ada2e-6d50-45f3-af1e-283cc8eb0086 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:09.833656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fe08d-c755-4d2b-93c3-d9d8002fff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:09.834322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fe08d-c755-4d2b-93c3-d9d8002fff4f None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:09.834602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fe08d-c755-4d2b-93c3-d9d8002fff4f None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:09.834876 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fe08d-c755-4d2b-93c3-d9d8002fff4f None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:09.835642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fe08d-c755-4d2b-93c3-d9d8002fff4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:09.835957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fe08d-c755-4d2b-93c3-d9d8002fff4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:09.837342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fe08d-c755-4d2b-93c3-d9d8002fff4f None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:09.849777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 613/1238] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:09.855299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c90e-b4b0-4f9d-bfa9-9178fc359062 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:09.984298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c90e-b4b0-4f9d-bfa9-9178fc359062 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:10.027659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff179895-5d4a-4270-a0d2-c2d55246e880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:10.028473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff179895-5d4a-4270-a0d2-c2d55246e880 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:10.028854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff179895-5d4a-4270-a0d2-c2d55246e880 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:10.029166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff179895-5d4a-4270-a0d2-c2d55246e880 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:10.038906 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff179895-5d4a-4270-a0d2-c2d55246e880 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:10.040559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff179895-5d4a-4270-a0d2-c2d55246e880 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-ff179895-5d4a-4270-a0d2-c2d55246e880 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:21:10.056724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:10.059097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:10.061627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 626/1239] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:10.065261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fe08d-c755-4d2b-93c3-d9d8002fff4f None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:10.212754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fe08d-c755-4d2b-93c3-d9d8002fff4f None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:10.253610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45fd25-335e-4e6d-89cb-37019a8e5fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:10.254290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45fd25-335e-4e6d-89cb-37019a8e5fcd None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:10.255241 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45fd25-335e-4e6d-89cb-37019a8e5fcd None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:10.255637 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45fd25-335e-4e6d-89cb-37019a8e5fcd None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:10.256281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45fd25-335e-4e6d-89cb-37019a8e5fcd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:10.256595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45fd25-335e-4e6d-89cb-37019a8e5fcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:10.258036 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45fd25-335e-4e6d-89cb-37019a8e5fcd None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:10.277371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 614/1240] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 12 14:21:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:10.283408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff179895-5d4a-4270-a0d2-c2d55246e880 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:10.390926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff179895-5d4a-4270-a0d2-c2d55246e880 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:10.430048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c43700-b9bc-4d46-8942-95dc4c95b496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:10.430717 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c43700-b9bc-4d46-8942-95dc4c95b496 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:10.431059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c43700-b9bc-4d46-8942-95dc4c95b496 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:10.431353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c43700-b9bc-4d46-8942-95dc4c95b496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:10.507218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c43700-b9bc-4d46-8942-95dc4c95b496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:10.508624 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c43700-b9bc-4d46-8942-95dc4c95b496 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:10.618909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 627/1241] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:21:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:21:10.624797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45fd25-335e-4e6d-89cb-37019a8e5fcd None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:10.746908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45fd25-335e-4e6d-89cb-37019a8e5fcd None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:10.784112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b981f-1be5-4712-9556-85b674167b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:10.784827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b981f-1be5-4712-9556-85b674167b8e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:10.785110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b981f-1be5-4712-9556-85b674167b8e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:10.785392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b981f-1be5-4712-9556-85b674167b8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:10.796824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b981f-1be5-4712-9556-85b674167b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:10.798482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b981f-1be5-4712-9556-85b674167b8e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-542b981f-1be5-4712-9556-85b674167b8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:10.820503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:10.821899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:10.822805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:10.822805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:10.822805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:10.822805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:10.822805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 615/1242] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:10.828058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c43700-b9bc-4d46-8942-95dc4c95b496 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:10.944255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c43700-b9bc-4d46-8942-95dc4c95b496 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:10.982737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad48a1-f68b-4fc8-b94c-f40685f4eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:10.983435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad48a1-f68b-4fc8-b94c-f40685f4eac4 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:10.983716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad48a1-f68b-4fc8-b94c-f40685f4eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:10.983989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad48a1-f68b-4fc8-b94c-f40685f4eac4 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:10.984717 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad48a1-f68b-4fc8-b94c-f40685f4eac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:10.985020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad48a1-f68b-4fc8-b94c-f40685f4eac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:10.986475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad48a1-f68b-4fc8-b94c-f40685f4eac4 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:10.999827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 628/1243] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:21:11.006643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b981f-1be5-4712-9556-85b674167b8e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:11.130466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b981f-1be5-4712-9556-85b674167b8e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:11.172919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b321232-73c4-4eeb-9d49-7c61b91890cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:11.173818 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b321232-73c4-4eeb-9d49-7c61b91890cd None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:11.174138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b321232-73c4-4eeb-9d49-7c61b91890cd None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:11.174379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b321232-73c4-4eeb-9d49-7c61b91890cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:11.183131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b321232-73c4-4eeb-9d49-7c61b91890cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:11.184704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b321232-73c4-4eeb-9d49-7c61b91890cd None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-7b321232-73c4-4eeb-9d49-7c61b91890cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:21:11.200369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:11.201475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:11.202400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:21:11.202400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:21:11.202400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:21:11.202400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:21:11.202400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:21:11.202400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:21:11.202400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:11.202400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:11.207092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 616/1244] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:21:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:11.208462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad48a1-f68b-4fc8-b94c-f40685f4eac4 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:11.331709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad48a1-f68b-4fc8-b94c-f40685f4eac4 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:11.372750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628911-6559-485e-b518-561f2b648eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:11.374278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628911-6559-485e-b518-561f2b648eca None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:11.374278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628911-6559-485e-b518-561f2b648eca None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:11.374278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628911-6559-485e-b518-561f2b648eca None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:11.375281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628911-6559-485e-b518-561f2b648eca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:11.375443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628911-6559-485e-b518-561f2b648eca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:11.376836 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38628911-6559-485e-b518-561f2b648eca None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:11.391228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 629/1245] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:21:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:21:11.397848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b321232-73c4-4eeb-9d49-7c61b91890cd None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:11.522731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b321232-73c4-4eeb-9d49-7c61b91890cd None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:11.561147 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cc231-4b5d-455d-82b9-6290391e6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:11.561813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc231-4b5d-455d-82b9-6290391e6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:11.562106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc231-4b5d-455d-82b9-6290391e6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:11.562387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc231-4b5d-455d-82b9-6290391e6cc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:11.563263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cc231-4b5d-455d-82b9-6290391e6cc2 None admin] RBAC: Adding query filter params (role.id=74e0a16c92f749e793a06bd6cbb9b2b6, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=3004f3e4a9854502be59119e17e04961) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:11.563583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cc231-4b5d-455d-82b9-6290391e6cc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:11.565019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cc231-4b5d-455d-82b9-6290391e6cc2 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:11.571250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 617/1246] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:21:11 2022] GET /identity/v3/role_assignments?user.id=3004f3e4a9854502be59119e17e04961&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=74e0a16c92f749e793a06bd6cbb9b2b6 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:21:14.122407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9441d7-7cfa-469b-b210-d469873e5a9e None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:14.123261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9441d7-7cfa-469b-b210-d469873e5a9e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:14.123261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9441d7-7cfa-469b-b210-d469873e5a9e None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:14.124390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 630/1247] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:21:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:21:14.131077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cef49-1d29-41f8-8da2-f2747213103d None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:14.131641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cef49-1d29-41f8-8da2-f2747213103d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:14.131641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cef49-1d29-41f8-8da2-f2747213103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:14.151773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-622cef49-1d29-41f8-8da2-f2747213103d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:21:14.153164 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-622cef49-1d29-41f8-8da2-f2747213103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:21:14.241495 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 618/1248] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:21:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:21:14.268020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9441d7-7cfa-469b-b210-d469873e5a9e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:14.386054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9441d7-7cfa-469b-b210-d469873e5a9e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:14.424906 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331db7-0f36-472d-9bbe-38d68ea0e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:14.425824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331db7-0f36-472d-9bbe-38d68ea0e6bc None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:14.426205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331db7-0f36-472d-9bbe-38d68ea0e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:14.427081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12331db7-0f36-472d-9bbe-38d68ea0e6bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:14.440186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12331db7-0f36-472d-9bbe-38d68ea0e6bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-12331db7-0f36-472d-9bbe-38d68ea0e6bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:21:14.449742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:14.451002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:21:14.451975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:14.456606 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 631/1249] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:21:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:14.458012 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cef49-1d29-41f8-8da2-f2747213103d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:14.573581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cef49-1d29-41f8-8da2-f2747213103d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:14.610903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645871-b390-4492-988a-5c08fa0c8880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:14.611718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645871-b390-4492-988a-5c08fa0c8880 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:14.612006 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645871-b390-4492-988a-5c08fa0c8880 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:14.612288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70645871-b390-4492-988a-5c08fa0c8880 None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:14.613099 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70645871-b390-4492-988a-5c08fa0c8880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:14.613410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70645871-b390-4492-988a-5c08fa0c8880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:14.615198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70645871-b390-4492-988a-5c08fa0c8880 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:14.625522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 619/1250] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:21:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:14.633384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331db7-0f36-472d-9bbe-38d68ea0e6bc None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:14.758823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12331db7-0f36-472d-9bbe-38d68ea0e6bc None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:14.798979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241c307-45aa-4ce7-b8b4-78e8740dbd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:14.799850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241c307-45aa-4ce7-b8b4-78e8740dbd13 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:14.800481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241c307-45aa-4ce7-b8b4-78e8740dbd13 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:14.800848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241c307-45aa-4ce7-b8b4-78e8740dbd13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:14.816400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241c307-45aa-4ce7-b8b4-78e8740dbd13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:14.816866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241c307-45aa-4ce7-b8b4-78e8740dbd13 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-1241c307-45aa-4ce7-b8b4-78e8740dbd13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:14.834658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:14.837137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:14.838067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:14.838067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:14.838067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:14.838067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:14.838067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 632/1251] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:14.842335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645871-b390-4492-988a-5c08fa0c8880 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:14.960246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70645871-b390-4492-988a-5c08fa0c8880 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:15.006497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0673b1-c351-4c7a-ba7d-aed6e25723b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:15.007246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0673b1-c351-4c7a-ba7d-aed6e25723b2 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:15.007573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0673b1-c351-4c7a-ba7d-aed6e25723b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:15.007886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0673b1-c351-4c7a-ba7d-aed6e25723b2 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:15.008711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0673b1-c351-4c7a-ba7d-aed6e25723b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:15.009088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0673b1-c351-4c7a-ba7d-aed6e25723b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:15.010629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0673b1-c351-4c7a-ba7d-aed6e25723b2 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:15.024133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 620/1252] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:15.032417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241c307-45aa-4ce7-b8b4-78e8740dbd13 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:15.149714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241c307-45aa-4ce7-b8b4-78e8740dbd13 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:15.196273 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72319686-f168-433e-a8c5-de5a772f1cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:15.197148 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72319686-f168-433e-a8c5-de5a772f1cf8 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:15.197428 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72319686-f168-433e-a8c5-de5a772f1cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:15.197699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72319686-f168-433e-a8c5-de5a772f1cf8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:15.211069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72319686-f168-433e-a8c5-de5a772f1cf8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:15.213370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72319686-f168-433e-a8c5-de5a772f1cf8 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-72319686-f168-433e-a8c5-de5a772f1cf8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:21:15.233169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:15.234427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:15.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 633/1253] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:15.245137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0673b1-c351-4c7a-ba7d-aed6e25723b2 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:15.357774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0673b1-c351-4c7a-ba7d-aed6e25723b2 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:15.396103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7ef1b-8a19-4ac3-813e-be262c2b93ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:15.396782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7ef1b-8a19-4ac3-813e-be262c2b93ee None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:15.397061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7ef1b-8a19-4ac3-813e-be262c2b93ee None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:15.397343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7ef1b-8a19-4ac3-813e-be262c2b93ee None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:15.398294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7ef1b-8a19-4ac3-813e-be262c2b93ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:15.398600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7ef1b-8a19-4ac3-813e-be262c2b93ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:15.400139 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7ef1b-8a19-4ac3-813e-be262c2b93ee None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:15.423102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 621/1254] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 12 14:21:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:15.428288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72319686-f168-433e-a8c5-de5a772f1cf8 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:15.558519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72319686-f168-433e-a8c5-de5a772f1cf8 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:15.609062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f8ab2-8fc1-4c2d-b010-4af6bb86ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:15.610091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f8ab2-8fc1-4c2d-b010-4af6bb86ca17 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:15.610386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f8ab2-8fc1-4c2d-b010-4af6bb86ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:15.610665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f8ab2-8fc1-4c2d-b010-4af6bb86ca17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:15.689795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f8ab2-8fc1-4c2d-b010-4af6bb86ca17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:15.691233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f8ab2-8fc1-4c2d-b010-4af6bb86ca17 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:15.796107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 634/1255] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:21:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:21:15.802126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7ef1b-8a19-4ac3-813e-be262c2b93ee None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:15.914393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7ef1b-8a19-4ac3-813e-be262c2b93ee None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:15.963306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca6c1e-c816-4427-9bbb-c9e068684b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:15.964386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca6c1e-c816-4427-9bbb-c9e068684b9c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:15.964865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca6c1e-c816-4427-9bbb-c9e068684b9c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:15.965333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca6c1e-c816-4427-9bbb-c9e068684b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:15.978394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca6c1e-c816-4427-9bbb-c9e068684b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:15.980041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca6c1e-c816-4427-9bbb-c9e068684b9c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-fbca6c1e-c816-4427-9bbb-c9e068684b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:16.000607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:16.001746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:16.002777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:16.002777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:16.002777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:16.002777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:16.002777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 622/1256] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:16.008153 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f8ab2-8fc1-4c2d-b010-4af6bb86ca17 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:16.119605 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f8ab2-8fc1-4c2d-b010-4af6bb86ca17 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:16.161319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0fd5c-cbee-4573-8a11-bcdfe1024b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:16.162356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0fd5c-cbee-4573-8a11-bcdfe1024b7d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:16.162356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0fd5c-cbee-4573-8a11-bcdfe1024b7d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:16.162663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0fd5c-cbee-4573-8a11-bcdfe1024b7d None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:16.163285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0fd5c-cbee-4573-8a11-bcdfe1024b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:16.163589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0fd5c-cbee-4573-8a11-bcdfe1024b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:16.164979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0fd5c-cbee-4573-8a11-bcdfe1024b7d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:16.182531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 635/1257] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:21:16.186886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca6c1e-c816-4427-9bbb-c9e068684b9c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:16.295399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca6c1e-c816-4427-9bbb-c9e068684b9c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:16.335881 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be726c1-8e25-4873-a4ec-b59a0f1526d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:16.336992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be726c1-8e25-4873-a4ec-b59a0f1526d3 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:16.337303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be726c1-8e25-4873-a4ec-b59a0f1526d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:16.337707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be726c1-8e25-4873-a4ec-b59a0f1526d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:16.344909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be726c1-8e25-4873-a4ec-b59a0f1526d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:16.346672 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be726c1-8e25-4873-a4ec-b59a0f1526d3 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-3be726c1-8e25-4873-a4ec-b59a0f1526d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:21:16.366273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:16.367764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:16.368673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:21:16.368673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:21:16.368673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:21:16.368673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:21:16.368673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:21:16.368673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:21:16.368673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:16.368673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:16.368673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 623/1258] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:21:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:16.374001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0fd5c-cbee-4573-8a11-bcdfe1024b7d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:16.497684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0fd5c-cbee-4573-8a11-bcdfe1024b7d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:16.536376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477debb-a657-4ce2-86f9-355671047794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:16.537356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477debb-a657-4ce2-86f9-355671047794 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:16.537678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477debb-a657-4ce2-86f9-355671047794 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:16.537955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477debb-a657-4ce2-86f9-355671047794 None admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:16.538820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477debb-a657-4ce2-86f9-355671047794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:16.539160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477debb-a657-4ce2-86f9-355671047794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:16.540758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477debb-a657-4ce2-86f9-355671047794 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:16.557479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 636/1259] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:21:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:16.563488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be726c1-8e25-4873-a4ec-b59a0f1526d3 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:16.672414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be726c1-8e25-4873-a4ec-b59a0f1526d3 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:16.710002 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79afa49-0c09-4a2c-a5c6-8a38eef279d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:16.710703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79afa49-0c09-4a2c-a5c6-8a38eef279d8 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:16.710991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79afa49-0c09-4a2c-a5c6-8a38eef279d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:16.711293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79afa49-0c09-4a2c-a5c6-8a38eef279d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:16.712184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79afa49-0c09-4a2c-a5c6-8a38eef279d8 None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=3004f3e4a9854502be59119e17e04961) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:16.712574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79afa49-0c09-4a2c-a5c6-8a38eef279d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:16.714063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79afa49-0c09-4a2c-a5c6-8a38eef279d8 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:16.719742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 624/1260] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:21:16 2022] GET /identity/v3/role_assignments?user.id=3004f3e4a9854502be59119e17e04961&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:18.964375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e30233-a7ef-44ed-bf34-e2c720ec94a9 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:18.964375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e30233-a7ef-44ed-bf34-e2c720ec94a9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:18.964828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e30233-a7ef-44ed-bf34-e2c720ec94a9 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:18.965855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 637/1261] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:21:18.971200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0896b-c711-4237-b08a-6bdf4fa12de6 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:18.971615 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0896b-c711-4237-b08a-6bdf4fa12de6 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:18.971766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac0896b-c711-4237-b08a-6bdf4fa12de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:18.988449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-eac0896b-c711-4237-b08a-6bdf4fa12de6 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:21:18.990169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-eac0896b-c711-4237-b08a-6bdf4fa12de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:21:19.058595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 625/1262] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:21:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:21:19.080903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e30233-a7ef-44ed-bf34-e2c720ec94a9 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:19.179875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e30233-a7ef-44ed-bf34-e2c720ec94a9 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:19.213354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eef46-0599-4080-a86a-c64fff8705fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:19.214214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eef46-0599-4080-a86a-c64fff8705fc None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:19.214435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eef46-0599-4080-a86a-c64fff8705fc None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:19.214709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eef46-0599-4080-a86a-c64fff8705fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:19.225144 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492eef46-0599-4080-a86a-c64fff8705fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-492eef46-0599-4080-a86a-c64fff8705fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:21:19.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:19.233618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:19.234494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 638/1263] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:21:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:19.240414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0896b-c711-4237-b08a-6bdf4fa12de6 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:19.336793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac0896b-c711-4237-b08a-6bdf4fa12de6 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:19.370064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99aa19f-97a8-4b48-b0b3-a602c60dae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:19.370747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aa19f-97a8-4b48-b0b3-a602c60dae9c None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:19.371050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aa19f-97a8-4b48-b0b3-a602c60dae9c None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:19.371345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99aa19f-97a8-4b48-b0b3-a602c60dae9c None admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:19.372093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99aa19f-97a8-4b48-b0b3-a602c60dae9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:19.372403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99aa19f-97a8-4b48-b0b3-a602c60dae9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:19.373769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99aa19f-97a8-4b48-b0b3-a602c60dae9c None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:19.381769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 626/1264] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:21:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:21:19.387473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eef46-0599-4080-a86a-c64fff8705fc None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:19.482944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eef46-0599-4080-a86a-c64fff8705fc None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:19.514306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e4c24-369b-4d22-b173-72d0edad9b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:19.515223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e4c24-369b-4d22-b173-72d0edad9b91 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:19.515769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e4c24-369b-4d22-b173-72d0edad9b91 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:19.516043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e4c24-369b-4d22-b173-72d0edad9b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:19.526750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e4c24-369b-4d22-b173-72d0edad9b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:19.528246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e4c24-369b-4d22-b173-72d0edad9b91 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-694e4c24-369b-4d22-b173-72d0edad9b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:19.545215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:19.547195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:19.548719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:19.548719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:19.548719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:19.548719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:19.548719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 639/1265] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:19.552334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99aa19f-97a8-4b48-b0b3-a602c60dae9c None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:19.648551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99aa19f-97a8-4b48-b0b3-a602c60dae9c None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:19.680056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787e74f-bda0-49cc-b355-748630396819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:19.680709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787e74f-bda0-49cc-b355-748630396819 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:19.680990 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787e74f-bda0-49cc-b355-748630396819 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:19.681263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787e74f-bda0-49cc-b355-748630396819 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:19.681971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787e74f-bda0-49cc-b355-748630396819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:19.682271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787e74f-bda0-49cc-b355-748630396819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:19.683650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787e74f-bda0-49cc-b355-748630396819 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:19.695337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 627/1266] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:19.700881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e4c24-369b-4d22-b173-72d0edad9b91 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:19.804855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e4c24-369b-4d22-b173-72d0edad9b91 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:19.838373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2a792-f17e-4559-935a-840e6859dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:19.839209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a792-f17e-4559-935a-840e6859dba1 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:19.839521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a792-f17e-4559-935a-840e6859dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:19.839799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a792-f17e-4559-935a-840e6859dba1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:19.847527 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2a792-f17e-4559-935a-840e6859dba1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:19.849023 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2a792-f17e-4559-935a-840e6859dba1 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-4ca2a792-f17e-4559-935a-840e6859dba1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:21:19.863893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:19.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:19.866729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 640/1267] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:19.873800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787e74f-bda0-49cc-b355-748630396819 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:19.996815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787e74f-bda0-49cc-b355-748630396819 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:20.032734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7573e2-8fd0-4ed5-881f-94dace289563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:20.033414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7573e2-8fd0-4ed5-881f-94dace289563 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:20.033703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7573e2-8fd0-4ed5-881f-94dace289563 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:20.033984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7573e2-8fd0-4ed5-881f-94dace289563 None admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:20.034843 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7573e2-8fd0-4ed5-881f-94dace289563 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:20.035226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7573e2-8fd0-4ed5-881f-94dace289563 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:20.037211 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7573e2-8fd0-4ed5-881f-94dace289563 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:20.055979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 628/1268] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 12 14:21:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:20.061500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2a792-f17e-4559-935a-840e6859dba1 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:20.156849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2a792-f17e-4559-935a-840e6859dba1 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:20.189172 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbba567-269b-4383-9c9b-844bbcda01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:20.189968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbba567-269b-4383-9c9b-844bbcda01c5 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:20.190253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbba567-269b-4383-9c9b-844bbcda01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:20.190527 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbba567-269b-4383-9c9b-844bbcda01c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:20.201600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbba567-269b-4383-9c9b-844bbcda01c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:20.203074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbba567-269b-4383-9c9b-844bbcda01c5 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-9bbba567-269b-4383-9c9b-844bbcda01c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:20.219669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:20.220797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:20.221744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:20.221744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:20.221744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:20.221744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:20.221744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 641/1269] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:20.226701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7573e2-8fd0-4ed5-881f-94dace289563 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:20.321574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7573e2-8fd0-4ed5-881f-94dace289563 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:20.355762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783609c-8635-4bbf-ade2-3f87df788f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:20.356436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783609c-8635-4bbf-ade2-3f87df788f48 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:20.356717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783609c-8635-4bbf-ade2-3f87df788f48 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:20.356995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783609c-8635-4bbf-ade2-3f87df788f48 None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:20.357722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783609c-8635-4bbf-ade2-3f87df788f48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:20.358035 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783609c-8635-4bbf-ade2-3f87df788f48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:20.359431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783609c-8635-4bbf-ade2-3f87df788f48 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:20.370970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 629/1270] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:20.376575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbba567-269b-4383-9c9b-844bbcda01c5 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:20.470921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbba567-269b-4383-9c9b-844bbcda01c5 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:20.502861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cbd74-fe11-482f-a61b-0bb91dc44a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:20.503672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cbd74-fe11-482f-a61b-0bb91dc44a6a None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:20.503952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cbd74-fe11-482f-a61b-0bb91dc44a6a None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:20.504267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cbd74-fe11-482f-a61b-0bb91dc44a6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:20.511859 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cbd74-fe11-482f-a61b-0bb91dc44a6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:20.513309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9cbd74-fe11-482f-a61b-0bb91dc44a6a None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-8c9cbd74-fe11-482f-a61b-0bb91dc44a6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:21:20.528256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:20.529323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:20.530264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:21:20.530264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:21:20.530264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:21:20.530264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:21:20.530264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:21:20.530264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:21:20.530264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:20.530264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:20.530264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 642/1271] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:21:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:20.535263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783609c-8635-4bbf-ade2-3f87df788f48 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:20.631250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783609c-8635-4bbf-ade2-3f87df788f48 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:20.663619 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c6a57-9858-4f1f-82dc-741ed11ba70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:20.664273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6a57-9858-4f1f-82dc-741ed11ba70a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:20.664553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6a57-9858-4f1f-82dc-741ed11ba70a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:20.664822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c6a57-9858-4f1f-82dc-741ed11ba70a None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:20.665598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6a57-9858-4f1f-82dc-741ed11ba70a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:20.665905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6a57-9858-4f1f-82dc-741ed11ba70a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:20.667357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c6a57-9858-4f1f-82dc-741ed11ba70a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:20.680374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 630/1272] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:21:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:20.686402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cbd74-fe11-482f-a61b-0bb91dc44a6a None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:20.781503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cbd74-fe11-482f-a61b-0bb91dc44a6a None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:20.813733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa8d31-bd47-49be-aadc-6824938c8f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:20.814613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa8d31-bd47-49be-aadc-6824938c8f14 None admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:20.814896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa8d31-bd47-49be-aadc-6824938c8f14 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:20.815204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa8d31-bd47-49be-aadc-6824938c8f14 None admin] PATH_INFO: `/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/3004f3e4a9854502be59119e17e04961/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:20.817699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa8d31-bd47-49be-aadc-6824938c8f14 None admin] RBAC: Authorizing `identity:create_grant(project_id=1882b54135a443aca586cbb1d5c0e8f3, user_id=3004f3e4a9854502be59119e17e04961, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:20.819176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa8d31-bd47-49be-aadc-6824938c8f14 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:20.831433 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 643/1273] 10.222.0.75 () {58 vars in 1439 bytes} [Thu May 12 14:21:20 2022] PUT /identity/v3/projects/1882b54135a443aca586cbb1d5c0e8f3/users/3004f3e4a9854502be59119e17e04961/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:21:23.075463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967f987-2811-46be-bee0-dc6658945b39 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:23.076030 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967f987-2811-46be-bee0-dc6658945b39 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:23.076301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967f987-2811-46be-bee0-dc6658945b39 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:23.078456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 631/1274] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:21:23.084170 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15710ffc-466a-4ee2-9ebc-4da875018c15 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:23.084689 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15710ffc-466a-4ee2-9ebc-4da875018c15 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:23.084783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15710ffc-466a-4ee2-9ebc-4da875018c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:23.101878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-15710ffc-466a-4ee2-9ebc-4da875018c15 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:21:23.103100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-15710ffc-466a-4ee2-9ebc-4da875018c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:21:23.167333 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 644/1275] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:21:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 12 14:21:23.191374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967f987-2811-46be-bee0-dc6658945b39 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:23.295067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967f987-2811-46be-bee0-dc6658945b39 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:23.327209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772b0e0-851d-4e53-8f92-a9101dd8a836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:23.327991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772b0e0-851d-4e53-8f92-a9101dd8a836 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:23.328268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772b0e0-851d-4e53-8f92-a9101dd8a836 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:23.328540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772b0e0-851d-4e53-8f92-a9101dd8a836 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:23.338864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772b0e0-851d-4e53-8f92-a9101dd8a836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-1772b0e0-851d-4e53-8f92-a9101dd8a836 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(role_id) May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 12 14:21:23.346453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:23.347436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:23.348905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 632/1276] 10.222.0.75 () {56 vars in 1096 bytes} [Thu May 12 14:21:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:23.354240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15710ffc-466a-4ee2-9ebc-4da875018c15 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:23.452023 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15710ffc-466a-4ee2-9ebc-4da875018c15 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:23.490246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23eac4-eea5-44b9-9db1-2c17707c9390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:23.490908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23eac4-eea5-44b9-9db1-2c17707c9390 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:23.491304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23eac4-eea5-44b9-9db1-2c17707c9390 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:23.491573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23eac4-eea5-44b9-9db1-2c17707c9390 None admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:23.492314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23eac4-eea5-44b9-9db1-2c17707c9390 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:23.492617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23eac4-eea5-44b9-9db1-2c17707c9390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:23.493989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23eac4-eea5-44b9-9db1-2c17707c9390 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:23.502008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 645/1277] 10.222.0.75 () {56 vars in 1099 bytes} [Thu May 12 14:21:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:23.507690 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772b0e0-851d-4e53-8f92-a9101dd8a836 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:23.604431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772b0e0-851d-4e53-8f92-a9101dd8a836 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:23.637255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e69df7-9abb-4013-b446-345612b6f1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:23.638046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e69df7-9abb-4013-b446-345612b6f1e6 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:23.638327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e69df7-9abb-4013-b446-345612b6f1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:23.638603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e69df7-9abb-4013-b446-345612b6f1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:23.650990 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e69df7-9abb-4013-b446-345612b6f1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:23.652528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e69df7-9abb-4013-b446-345612b6f1e6 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-82e69df7-9abb-4013-b446-345612b6f1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:23.669667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:23.670778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:23.671774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:23.671774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:23.671774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:23.671774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:23.671774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 633/1278] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:23.676628 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23eac4-eea5-44b9-9db1-2c17707c9390 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:23.775360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23eac4-eea5-44b9-9db1-2c17707c9390 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:23.807041 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902d556-5e32-448a-9f50-078d9ff13f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:23.807726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d556-5e32-448a-9f50-078d9ff13f82 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:23.808009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d556-5e32-448a-9f50-078d9ff13f82 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:23.808284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d556-5e32-448a-9f50-078d9ff13f82 None admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:23.809012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902d556-5e32-448a-9f50-078d9ff13f82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:23.809320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902d556-5e32-448a-9f50-078d9ff13f82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:23.810696 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902d556-5e32-448a-9f50-078d9ff13f82 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:23.823718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 646/1279] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:23.829527 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e69df7-9abb-4013-b446-345612b6f1e6 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:23.944067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e69df7-9abb-4013-b446-345612b6f1e6 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:23.979496 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88d9c3-ffec-45da-a2eb-960c1398bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:23.980295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88d9c3-ffec-45da-a2eb-960c1398bd33 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:23.980572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88d9c3-ffec-45da-a2eb-960c1398bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:23.980842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88d9c3-ffec-45da-a2eb-960c1398bd33 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:23.988242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88d9c3-ffec-45da-a2eb-960c1398bd33 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:23.990252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88d9c3-ffec-45da-a2eb-960c1398bd33 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-3a88d9c3-ffec-45da-a2eb-960c1398bd33 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_user(user_id) May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 12 14:21:24.005531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:24.008930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:24.011708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 634/1280] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:24.013379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902d556-5e32-448a-9f50-078d9ff13f82 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:24.110529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902d556-5e32-448a-9f50-078d9ff13f82 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:24.144877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c693b-6e14-4e30-833e-231aae748f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:24.145650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c693b-6e14-4e30-833e-231aae748f3d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:24.145938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c693b-6e14-4e30-833e-231aae748f3d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:24.146218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c693b-6e14-4e30-833e-231aae748f3d None admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:24.147085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c693b-6e14-4e30-833e-231aae748f3d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:24.147401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c693b-6e14-4e30-833e-231aae748f3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:24.148855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c693b-6e14-4e30-833e-231aae748f3d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:24.167120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 647/1281] 10.222.0.75 () {56 vars in 1143 bytes} [Thu May 12 14:21:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:24.173102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88d9c3-ffec-45da-a2eb-960c1398bd33 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:24.273553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88d9c3-ffec-45da-a2eb-960c1398bd33 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:24.307204 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818a19-8b58-4b24-9080-d16f447e1eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:24.307858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818a19-8b58-4b24-9080-d16f447e1eb5 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:24.308148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818a19-8b58-4b24-9080-d16f447e1eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:24.308430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818a19-8b58-4b24-9080-d16f447e1eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:24.374049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da818a19-8b58-4b24-9080-d16f447e1eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:24.375543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da818a19-8b58-4b24-9080-d16f447e1eb5 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:24.491114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 635/1282] 10.222.0.75 () {58 vars in 1282 bytes} [Thu May 12 14:21:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 12 14:21:24.496945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c693b-6e14-4e30-833e-231aae748f3d None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:24.595753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c693b-6e14-4e30-833e-231aae748f3d None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:24.629800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ee245-ff33-482e-a793-1a8943ddb9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:24.630586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee245-ff33-482e-a793-1a8943ddb9fe None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:24.630866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee245-ff33-482e-a793-1a8943ddb9fe None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:24.631173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee245-ff33-482e-a793-1a8943ddb9fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:24.641391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ee245-ff33-482e-a793-1a8943ddb9fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:24.642841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ee245-ff33-482e-a793-1a8943ddb9fe None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-734ee245-ff33-482e-a793-1a8943ddb9fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 12 14:21:24.660101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:24.661707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:24.662601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 12 14:21:24.662601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 12 14:21:24.662601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 12 14:21:24.662601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:24.662601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 648/1283] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:24.667732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818a19-8b58-4b24-9080-d16f447e1eb5 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:24.765687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818a19-8b58-4b24-9080-d16f447e1eb5 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:24.801133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9093e7-f037-4516-adf9-8a6a934c8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:24.801810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9093e7-f037-4516-adf9-8a6a934c8d5a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:24.802097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9093e7-f037-4516-adf9-8a6a934c8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:24.802378 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9093e7-f037-4516-adf9-8a6a934c8d5a None admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:24.803131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9093e7-f037-4516-adf9-8a6a934c8d5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:24.803444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9093e7-f037-4516-adf9-8a6a934c8d5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:24.804813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9093e7-f037-4516-adf9-8a6a934c8d5a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:24.816142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 636/1284] 10.222.0.75 () {56 vars in 1109 bytes} [Thu May 12 14:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:24.822386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ee245-ff33-482e-a793-1a8943ddb9fe None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:24.922159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ee245-ff33-482e-a793-1a8943ddb9fe None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:24.957010 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4160943-3d6b-4c2f-a060-6207a67c9850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:24.958477 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160943-3d6b-4c2f-a060-6207a67c9850 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:24.958761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160943-3d6b-4c2f-a060-6207a67c9850 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:24.959056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4160943-3d6b-4c2f-a060-6207a67c9850 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:24.966091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4160943-3d6b-4c2f-a060-6207a67c9850 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:24.967605 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4160943-3d6b-4c2f-a060-6207a67c9850 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application [None req-e4160943-3d6b-4c2f-a060-6207a67c9850 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(project_id) May 12 14:21:24.981938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application with Lock( May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:24.983006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:24.984058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 12 14:21:24.984058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 12 14:21:24.984058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 12 14:21:24.984058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 12 14:21:24.984058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 12 14:21:24.984058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 12 14:21:24.984058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 12 14:21:24.984058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: ERROR keystone.server.flask.application May 12 14:21:24.984058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 649/1285] 10.222.0.75 () {56 vars in 1111 bytes} [Thu May 12 14:21:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:24.989049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9093e7-f037-4516-adf9-8a6a934c8d5a None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:25.087182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9093e7-f037-4516-adf9-8a6a934c8d5a None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:25.118932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583913a-9876-413e-9a01-b0d90e1265ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:25.119623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583913a-9876-413e-9a01-b0d90e1265ce None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:25.119906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583913a-9876-413e-9a01-b0d90e1265ce None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:25.120184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583913a-9876-413e-9a01-b0d90e1265ce None admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:25.120976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583913a-9876-413e-9a01-b0d90e1265ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:25.121287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583913a-9876-413e-9a01-b0d90e1265ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:25.122716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1583913a-9876-413e-9a01-b0d90e1265ce None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:25.135157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 637/1286] 10.222.0.75 () {56 vars in 1148 bytes} [Thu May 12 14:21:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:25.141490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4160943-3d6b-4c2f-a060-6207a67c9850 None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:25.239543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4160943-3d6b-4c2f-a060-6207a67c9850 None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:25.275637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c2ad2-45f1-494b-aca6-085d24bd7aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:25.275637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2ad2-45f1-494b-aca6-085d24bd7aff None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:25.275637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2ad2-45f1-494b-aca6-085d24bd7aff None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:25.275637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c2ad2-45f1-494b-aca6-085d24bd7aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:25.276113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c2ad2-45f1-494b-aca6-085d24bd7aff None admin] RBAC: Adding query filter params (role.id=02a0298a908048b98fa7cc654a4dd57a, scope.project.id=1882b54135a443aca586cbb1d5c0e8f3, user.id=3004f3e4a9854502be59119e17e04961) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:25.276409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c2ad2-45f1-494b-aca6-085d24bd7aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:25.277861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c2ad2-45f1-494b-aca6-085d24bd7aff None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:25.284119 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 650/1287] 10.222.0.75 () {56 vars in 1374 bytes} [Thu May 12 14:21:25 2022] GET /identity/v3/role_assignments?user.id=3004f3e4a9854502be59119e17e04961&scope.project.id=1882b54135a443aca586cbb1d5c0e8f3&role.id=02a0298a908048b98fa7cc654a4dd57a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:21:27.543511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45899ce-030c-4273-b20d-8661006643c2 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:27.544357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45899ce-030c-4273-b20d-8661006643c2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:27.544357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45899ce-030c-4273-b20d-8661006643c2 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:27.545415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 638/1288] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:21:27.550958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7a329-22f1-432c-9b3e-10ef8d8f7fa7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:27.551453 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7a329-22f1-432c-9b3e-10ef8d8f7fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:27.551561 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7a329-22f1-432c-9b3e-10ef8d8f7fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:27.568606 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b9d7a329-22f1-432c-9b3e-10ef8d8f7fa7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:21:27.569811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b9d7a329-22f1-432c-9b3e-10ef8d8f7fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:21:27.641353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 651/1289] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:21:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:21:27.664724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45899ce-030c-4273-b20d-8661006643c2 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:27.768568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45899ce-030c-4273-b20d-8661006643c2 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:27.802796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c39000-cf63-4877-bc28-eaa03a6bc738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:27.803545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c39000-cf63-4877-bc28-eaa03a6bc738 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:27.803826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c39000-cf63-4877-bc28-eaa03a6bc738 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:27.804097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c39000-cf63-4877-bc28-eaa03a6bc738 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:27.804754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c39000-cf63-4877-bc28-eaa03a6bc738 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:27.806120 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c39000-cf63-4877-bc28-eaa03a6bc738 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-32c39000-cf63-4877-bc28-eaa03a6bc738 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:27.818145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:27.819478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:27.820589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 639/1290] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 12 14:21:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:27.828798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7a329-22f1-432c-9b3e-10ef8d8f7fa7 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:27.952599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7a329-22f1-432c-9b3e-10ef8d8f7fa7 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:27.990517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d813d74-6a3c-409b-ae97-207988ab4fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:27.991238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d813d74-6a3c-409b-ae97-207988ab4fd3 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:27.991525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d813d74-6a3c-409b-ae97-207988ab4fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:27.991801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d813d74-6a3c-409b-ae97-207988ab4fd3 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:27.992513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d813d74-6a3c-409b-ae97-207988ab4fd3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:27.992823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d813d74-6a3c-409b-ae97-207988ab4fd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:27.994245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d813d74-6a3c-409b-ae97-207988ab4fd3 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:27.999306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 652/1291] 10.222.0.75 () {56 vars in 1116 bytes} [Thu May 12 14:21:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:28.005090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c39000-cf63-4877-bc28-eaa03a6bc738 None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:28.106829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c39000-cf63-4877-bc28-eaa03a6bc738 None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:28.139266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd07ffe-99fb-4b01-852b-42b2d3afdb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:28.139936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07ffe-99fb-4b01-852b-42b2d3afdb1a None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:28.140485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07ffe-99fb-4b01-852b-42b2d3afdb1a None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:28.140767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07ffe-99fb-4b01-852b-42b2d3afdb1a None admin] PATH_INFO: `/v3/services` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:28.141482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd07ffe-99fb-4b01-852b-42b2d3afdb1a None admin] RBAC: Adding query filter params (type=placement) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:28.141787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd07ffe-99fb-4b01-852b-42b2d3afdb1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:28.143178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd07ffe-99fb-4b01-852b-42b2d3afdb1a None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:28.148295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 640/1292] 10.222.0.75 () {56 vars in 1116 bytes} [Thu May 12 14:21:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:30.356562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e576a6-cb78-4ebf-823a-2e8963f9ac2c None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:30.357143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e576a6-cb78-4ebf-823a-2e8963f9ac2c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:30.357143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e576a6-cb78-4ebf-823a-2e8963f9ac2c None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:30.358473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 653/1293] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:21:30.364594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88223-14ef-4cda-b2b0-455e4c6221b3 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:30.365060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88223-14ef-4cda-b2b0-455e4c6221b3 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:30.365172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88223-14ef-4cda-b2b0-455e4c6221b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:30.382296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-8eb88223-14ef-4cda-b2b0-455e4c6221b3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:21:30.383556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8eb88223-14ef-4cda-b2b0-455e4c6221b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:21:30.448715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 641/1294] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:21:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:21:30.471897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e576a6-cb78-4ebf-823a-2e8963f9ac2c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:30.571714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e576a6-cb78-4ebf-823a-2e8963f9ac2c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:30.605412 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abbba7d-6511-43c4-ab60-e8e0c564cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:30.606081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbba7d-6511-43c4-ab60-e8e0c564cc8f None admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:30.606363 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbba7d-6511-43c4-ab60-e8e0c564cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:30.606691 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbba7d-6511-43c4-ab60-e8e0c564cc8f None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:30.607396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbba7d-6511-43c4-ab60-e8e0c564cc8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:30.608776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abbba7d-6511-43c4-ab60-e8e0c564cc8f None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:30.622678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 654/1295] 10.222.0.75 () {60 vars in 1141 bytes} [Thu May 12 14:21:30 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:21:32.907438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae0a7d-8585-4a58-8b2f-740745ee6e27 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:32.908000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae0a7d-8585-4a58-8b2f-740745ee6e27 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:32.908104 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae0a7d-8585-4a58-8b2f-740745ee6e27 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:32.909810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 642/1296] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:21:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:21:32.916457 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a107b-bf6c-4ba8-b2f9-76f31bf2df04 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:32.916967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a107b-bf6c-4ba8-b2f9-76f31bf2df04 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:32.917076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a107b-bf6c-4ba8-b2f9-76f31bf2df04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:32.934556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b59a107b-bf6c-4ba8-b2f9-76f31bf2df04 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:21:32.935828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b59a107b-bf6c-4ba8-b2f9-76f31bf2df04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:21:33.015726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 655/1297] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:21:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:21:33.039100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae0a7d-8585-4a58-8b2f-740745ee6e27 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:33.144146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae0a7d-8585-4a58-8b2f-740745ee6e27 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:33.177137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936e46f-9dce-4238-8a0e-8d29513c807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:33.177851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936e46f-9dce-4238-8a0e-8d29513c807d None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:33.178137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936e46f-9dce-4238-8a0e-8d29513c807d None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:33.178409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936e46f-9dce-4238-8a0e-8d29513c807d None admin] PATH_INFO: `/v3/services/placement` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:33.179089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936e46f-9dce-4238-8a0e-8d29513c807d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:33.180454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936e46f-9dce-4238-8a0e-8d29513c807d None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-7936e46f-9dce-4238-8a0e-8d29513c807d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:33.192678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:33.193904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:33.194991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 643/1298] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 12 14:21:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:33.200085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a107b-bf6c-4ba8-b2f9-76f31bf2df04 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:33.295223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a107b-bf6c-4ba8-b2f9-76f31bf2df04 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:33.328386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880a4b2-f123-4757-a10b-641e4123c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:33.329061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a4b2-f123-4757-a10b-641e4123c38c None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:33.329345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a4b2-f123-4757-a10b-641e4123c38c None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:33.329622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a4b2-f123-4757-a10b-641e4123c38c None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:33.330327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880a4b2-f123-4757-a10b-641e4123c38c None admin] RBAC: Adding query filter params (name=placement) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:33.330637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880a4b2-f123-4757-a10b-641e4123c38c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:33.332091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880a4b2-f123-4757-a10b-641e4123c38c None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:33.337148 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 656/1299] 10.222.0.75 () {56 vars in 1116 bytes} [Thu May 12 14:21:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:33.343182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936e46f-9dce-4238-8a0e-8d29513c807d None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:33.443426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936e46f-9dce-4238-8a0e-8d29513c807d None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:33.475451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ba0c1-ab53-46b8-b3b9-ab9c6108d970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:33.476139 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba0c1-ab53-46b8-b3b9-ab9c6108d970 None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:33.476424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba0c1-ab53-46b8-b3b9-ab9c6108d970 None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:33.476700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ba0c1-ab53-46b8-b3b9-ab9c6108d970 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:33.477500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ba0c1-ab53-46b8-b3b9-ab9c6108d970 None admin] RBAC: Adding query filter params (interface=public, service_id=3aad643cd16d46388a2fc10607476014, region_id=RegionOne) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:33.478202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ba0c1-ab53-46b8-b3b9-ab9c6108d970 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:33.479616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ba0c1-ab53-46b8-b3b9-ab9c6108d970 None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:33.491572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 644/1300] 10.222.0.75 () {56 vars in 1251 bytes} [Thu May 12 14:21:33 2022] GET /identity/v3/endpoints?service_id=3aad643cd16d46388a2fc10607476014&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:33.497878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880a4b2-f123-4757-a10b-641e4123c38c None admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:33.593687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880a4b2-f123-4757-a10b-641e4123c38c None admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:33.626354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce987f23-d80f-4da1-bd30-27a89db57b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:33.627015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce987f23-d80f-4da1-bd30-27a89db57b6d None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:33.627321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce987f23-d80f-4da1-bd30-27a89db57b6d None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:33.627595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce987f23-d80f-4da1-bd30-27a89db57b6d None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:33.628274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce987f23-d80f-4da1-bd30-27a89db57b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:33.630227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce987f23-d80f-4da1-bd30-27a89db57b6d None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:33.637079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 657/1301] 10.222.0.75 () {56 vars in 1087 bytes} [Thu May 12 14:21:33 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:21:35.886247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349fbb5-8655-4c0a-9fac-f241d8ee7a93 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:35.886814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349fbb5-8655-4c0a-9fac-f241d8ee7a93 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:35.886814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349fbb5-8655-4c0a-9fac-f241d8ee7a93 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:35.888387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 645/1302] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:21:35.894330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4cbc5-ad04-4aea-b9c3-36bd98e42bc7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:35.894909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4cbc5-ad04-4aea-b9c3-36bd98e42bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:35.894909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4cbc5-ad04-4aea-b9c3-36bd98e42bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:35.913120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-49b4cbc5-ad04-4aea-b9c3-36bd98e42bc7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:21:35.914350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-49b4cbc5-ad04-4aea-b9c3-36bd98e42bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:21:35.987743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 658/1303] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:21:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 12 14:21:36.010801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349fbb5-8655-4c0a-9fac-f241d8ee7a93 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:36.113895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349fbb5-8655-4c0a-9fac-f241d8ee7a93 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:36.153743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3ae19-2446-4daa-b6cc-9cbaf24ec87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:36.154459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3ae19-2446-4daa-b6cc-9cbaf24ec87e None admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:36.154744 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3ae19-2446-4daa-b6cc-9cbaf24ec87e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:36.155021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3ae19-2446-4daa-b6cc-9cbaf24ec87e None admin] PATH_INFO: `/v3/services/placement` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:36.155714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3ae19-2446-4daa-b6cc-9cbaf24ec87e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:36.157089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3ae19-2446-4daa-b6cc-9cbaf24ec87e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application [None req-d3a3ae19-2446-4daa-b6cc-9cbaf24ec87e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application Traceback (most recent call last): May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 12 14:21:36.169317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._get_service(service_id) May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 12 14:21:36.170588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.get_or_create( May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application with Lock( May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self._enter() May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application return self.creator() May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application created_value = creator( May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: ERROR keystone.server.flask.application May 12 14:21:36.171742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 646/1304] 10.222.0.75 () {56 vars in 1117 bytes} [Thu May 12 14:21:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 12 14:21:36.177485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4cbc5-ad04-4aea-b9c3-36bd98e42bc7 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:36.284623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4cbc5-ad04-4aea-b9c3-36bd98e42bc7 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:36.318826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98490dc-75fe-4e62-beb0-ab3699fc1e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:36.319520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98490dc-75fe-4e62-beb0-ab3699fc1e40 None admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:36.320593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98490dc-75fe-4e62-beb0-ab3699fc1e40 None admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:36.320593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98490dc-75fe-4e62-beb0-ab3699fc1e40 None admin] PATH_INFO: `/v3/services` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:36.320804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98490dc-75fe-4e62-beb0-ab3699fc1e40 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:21:36.321077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98490dc-75fe-4e62-beb0-ab3699fc1e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:36.322463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98490dc-75fe-4e62-beb0-ab3699fc1e40 None admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:36.328176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 659/1305] 10.222.0.75 () {56 vars in 1116 bytes} [Thu May 12 14:21:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:21:36.334663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3ae19-2446-4daa-b6cc-9cbaf24ec87e None admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:21:36.444592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3ae19-2446-4daa-b6cc-9cbaf24ec87e None admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:21:36.481590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad98dc-9eed-4f7b-95e7-68f96bf8c77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:21:36.482314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad98dc-9eed-4f7b-95e7-68f96bf8c77e None admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:21:36.482606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad98dc-9eed-4f7b-95e7-68f96bf8c77e None admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:21:36.482886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad98dc-9eed-4f7b-95e7-68f96bf8c77e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:21:36.483667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad98dc-9eed-4f7b-95e7-68f96bf8c77e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:21:36.485043 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad98dc-9eed-4f7b-95e7-68f96bf8c77e None admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:21:36.504772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 647/1306] 10.222.0.75 () {60 vars in 1144 bytes} [Thu May 12 14:21:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:22:42.486478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd59c5e-4c76-4c1e-8d9d-1f716b564595 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:42.487585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd59c5e-4c76-4c1e-8d9d-1f716b564595 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:42.488296 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd59c5e-4c76-4c1e-8d9d-1f716b564595 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:42.497144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ee743-0db7-43cf-8f97-de778e318762 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:42.498120 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ee743-0db7-43cf-8f97-de778e318762 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:42.498618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ee743-0db7-43cf-8f97-de778e318762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:42.503629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 660/1307] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:22:42 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:22:42.611545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-342ee743-0db7-43cf-8f97-de778e318762 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:42.613175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-342ee743-0db7-43cf-8f97-de778e318762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:42.896345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 648/1308] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:22:42.946884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aacb5c-ebd0-4533-8bd2-38bb0a174703 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:42.947559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aacb5c-ebd0-4533-8bd2-38bb0a174703 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:42.948077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aacb5c-ebd0-4533-8bd2-38bb0a174703 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:42.949909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 661/1309] 10.222.0.75 () {54 vars in 964 bytes} [Thu May 12 14:22:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:22:42.956995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89edf45-c51b-4612-a6b1-f8ed1e3af6db None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:42.957608 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89edf45-c51b-4612-a6b1-f8ed1e3af6db None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:42.958106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89edf45-c51b-4612-a6b1-f8ed1e3af6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:43.044403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-d89edf45-c51b-4612-a6b1-f8ed1e3af6db None None] MFA Rules not processed for user `5aca248c2e074fc4baff39930e21fe29`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:43.045529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d89edf45-c51b-4612-a6b1-f8ed1e3af6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:43.129755 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 649/1310] 10.222.0.75 () {58 vars in 1061 bytes} [Thu May 12 14:22:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:22:43.139339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aacb5c-ebd0-4533-8bd2-38bb0a174703 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:43.141190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-67aacb5c-ebd0-4533-8bd2-38bb0a174703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:43.253952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aacb5c-ebd0-4533-8bd2-38bb0a174703 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:43.335393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c4c8c-295f-48df-8851-c29655caf44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:43.336054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4c8c-295f-48df-8851-c29655caf44b service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:43.336333 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4c8c-295f-48df-8851-c29655caf44b service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:43.336602 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c4c8c-295f-48df-8851-c29655caf44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:43.338277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7d7c4c8c-295f-48df-8851-c29655caf44b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:43.458944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c4c8c-295f-48df-8851-c29655caf44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:43.460432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c4c8c-295f-48df-8851-c29655caf44b service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:43.479882 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 662/1311] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:22:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:22:46.043801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138936a-2f3f-46bc-ae3e-965054b9bbc2 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:46.044353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138936a-2f3f-46bc-ae3e-965054b9bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:46.044353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138936a-2f3f-46bc-ae3e-965054b9bbc2 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:46.050476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 650/1312] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:22:46.052525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ff03-e521-47f5-a283-36400487effc None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:46.053054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ff03-e521-47f5-a283-36400487effc None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:46.053302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0428ff03-e521-47f5-a283-36400487effc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:46.134110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-0428ff03-e521-47f5-a283-36400487effc None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:46.135371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0428ff03-e521-47f5-a283-36400487effc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:46.237281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 663/1313] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:22:46.274859 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138936a-2f3f-46bc-ae3e-965054b9bbc2 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:46.276471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6138936a-2f3f-46bc-ae3e-965054b9bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:46.389292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138936a-2f3f-46bc-ae3e-965054b9bbc2 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:46.472518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab6316-4c9d-4e71-b095-0990a31f7cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:46.473472 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab6316-4c9d-4e71-b095-0990a31f7cba service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:46.473901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab6316-4c9d-4e71-b095-0990a31f7cba service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:46.474337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab6316-4c9d-4e71-b095-0990a31f7cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:46.476170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-24ab6316-4c9d-4e71-b095-0990a31f7cba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:46.604310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab6316-4c9d-4e71-b095-0990a31f7cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:46.605786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab6316-4c9d-4e71-b095-0990a31f7cba service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:46.631109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 651/1314] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:22:49.249271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640461ca-c255-4320-ac30-ad756bee611c None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:49.249807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640461ca-c255-4320-ac30-ad756bee611c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:49.249807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640461ca-c255-4320-ac30-ad756bee611c None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:49.251684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 664/1315] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:22:49.256999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765eea2-21a0-4fc8-b377-9b66fb459bda None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:49.257438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765eea2-21a0-4fc8-b377-9b66fb459bda None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:49.257531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765eea2-21a0-4fc8-b377-9b66fb459bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:49.321345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5765eea2-21a0-4fc8-b377-9b66fb459bda None None] MFA Rules not processed for user `bf02ab5a7b8c4c06b4049a6a200a1195`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:49.322555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5765eea2-21a0-4fc8-b377-9b66fb459bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:49.419096 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 652/1316] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:22:49.472659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9be6-f023-449a-b7bd-7d84ee247474 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:49.472943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9be6-f023-449a-b7bd-7d84ee247474 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:49.473222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc9be6-f023-449a-b7bd-7d84ee247474 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:49.474653 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 665/1317] 10.222.0.75 () {54 vars in 964 bytes} [Thu May 12 14:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:22:49.480893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737232a-551e-4f14-bbb8-6623bde978ce None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:49.481193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737232a-551e-4f14-bbb8-6623bde978ce None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:49.481476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737232a-551e-4f14-bbb8-6623bde978ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:49.556658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-9737232a-551e-4f14-bbb8-6623bde978ce None None] MFA Rules not processed for user `5aca248c2e074fc4baff39930e21fe29`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:49.557799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9737232a-551e-4f14-bbb8-6623bde978ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:49.635796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 653/1318] 10.222.0.75 () {58 vars in 1061 bytes} [Thu May 12 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:22:49.645212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc9be6-f023-449a-b7bd-7d84ee247474 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:49.646753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-52bc9be6-f023-449a-b7bd-7d84ee247474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:49.749507 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc9be6-f023-449a-b7bd-7d84ee247474 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:49.821820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878788d3-170a-4f0e-a485-de9a14e3f7f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:49.822480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878788d3-170a-4f0e-a485-de9a14e3f7f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:49.822765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878788d3-170a-4f0e-a485-de9a14e3f7f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:49.823065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878788d3-170a-4f0e-a485-de9a14e3f7f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:49.824740 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-878788d3-170a-4f0e-a485-de9a14e3f7f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:49.940638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878788d3-170a-4f0e-a485-de9a14e3f7f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:49.942088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878788d3-170a-4f0e-a485-de9a14e3f7f4 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:49.960069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 666/1319] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:22:53.155096 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52f4c-dc2e-44ba-b724-e23dfa7b28a3 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:53.155626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52f4c-dc2e-44ba-b724-e23dfa7b28a3 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:53.155750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52f4c-dc2e-44ba-b724-e23dfa7b28a3 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:53.157080 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 654/1320] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:22:53.162472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fddcd-baac-41a1-b78b-2cd52fad84c9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:53.162941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fddcd-baac-41a1-b78b-2cd52fad84c9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:53.163068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fddcd-baac-41a1-b78b-2cd52fad84c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:53.227553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-2e7fddcd-baac-41a1-b78b-2cd52fad84c9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:53.228671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2e7fddcd-baac-41a1-b78b-2cd52fad84c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:53.331958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 667/1321] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:22:53.371754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c52f4c-dc2e-44ba-b724-e23dfa7b28a3 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:53.373294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-40c52f4c-dc2e-44ba-b724-e23dfa7b28a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:53.476924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c52f4c-dc2e-44ba-b724-e23dfa7b28a3 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:53.557169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2427d-7506-4bd6-9b5c-14dba27a9e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:53.557751 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2427d-7506-4bd6-9b5c-14dba27a9e7d service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:53.558031 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2427d-7506-4bd6-9b5c-14dba27a9e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:53.558305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2427d-7506-4bd6-9b5c-14dba27a9e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:53.560012 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c2b2427d-7506-4bd6-9b5c-14dba27a9e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:53.675400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2427d-7506-4bd6-9b5c-14dba27a9e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:53.676857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2427d-7506-4bd6-9b5c-14dba27a9e7d service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:53.694739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 655/1322] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:22:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:22:56.678290 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c6456-11c0-4a6e-90af-49fabc4cf1f3 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:56.678814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c6456-11c0-4a6e-90af-49fabc4cf1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:56.678814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c6456-11c0-4a6e-90af-49fabc4cf1f3 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:56.680193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 668/1323] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:22:56.685923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02291253-438e-40e8-8e9f-c39774924351 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:56.686396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02291253-438e-40e8-8e9f-c39774924351 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:56.686523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02291253-438e-40e8-8e9f-c39774924351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:56.753760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-02291253-438e-40e8-8e9f-c39774924351 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:56.755014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-02291253-438e-40e8-8e9f-c39774924351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:56.852993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 656/1324] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:22:56.893378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c6456-11c0-4a6e-90af-49fabc4cf1f3 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:56.895080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3f8c6456-11c0-4a6e-90af-49fabc4cf1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:57.002053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c6456-11c0-4a6e-90af-49fabc4cf1f3 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:57.075767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b403c3-b9f3-4f53-8ca3-8cc33cbeb503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:57.076422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b403c3-b9f3-4f53-8ca3-8cc33cbeb503 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:57.076705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b403c3-b9f3-4f53-8ca3-8cc33cbeb503 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:57.076981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b403c3-b9f3-4f53-8ca3-8cc33cbeb503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:57.079258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a9b403c3-b9f3-4f53-8ca3-8cc33cbeb503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:57.191012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b403c3-b9f3-4f53-8ca3-8cc33cbeb503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:22:57.192491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b403c3-b9f3-4f53-8ca3-8cc33cbeb503 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:22:57.211220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 669/1325] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:22:59.537420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e626-111d-4e9d-9ec7-2a0e3609579b None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:59.538020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e626-111d-4e9d-9ec7-2a0e3609579b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:59.538020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e626-111d-4e9d-9ec7-2a0e3609579b None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:59.539482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 657/1326] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:22:59.544929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f272d-9dd3-4a44-b8fd-82954398108c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:59.545507 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f272d-9dd3-4a44-b8fd-82954398108c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:59.545507 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f272d-9dd3-4a44-b8fd-82954398108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:59.624344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-772f272d-9dd3-4a44-b8fd-82954398108c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:22:59.625639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-772f272d-9dd3-4a44-b8fd-82954398108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:59.726520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 670/1327] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:22:59.762347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4e626-111d-4e9d-9ec7-2a0e3609579b None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:22:59.763968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e2d4e626-111d-4e9d-9ec7-2a0e3609579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:22:59.869485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4e626-111d-4e9d-9ec7-2a0e3609579b None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:22:59.943565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58838a41-57a0-4362-93a9-6953f9c41f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:22:59.944223 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58838a41-57a0-4362-93a9-6953f9c41f42 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:22:59.944505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58838a41-57a0-4362-93a9-6953f9c41f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:22:59.944780 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58838a41-57a0-4362-93a9-6953f9c41f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:22:59.946419 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-58838a41-57a0-4362-93a9-6953f9c41f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:00.057494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58838a41-57a0-4362-93a9-6953f9c41f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:00.058942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58838a41-57a0-4362-93a9-6953f9c41f42 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:00.076770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 658/1328] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:02.393822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0bb34-f345-44d2-9cca-4cb5ff17a769 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.394372 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0bb34-f345-44d2-9cca-4cb5ff17a769 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.394372 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0bb34-f345-44d2-9cca-4cb5ff17a769 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.395799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 671/1329] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:02.401391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dde39f-fc2a-4518-abb9-3c05d7309647 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.401891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dde39f-fc2a-4518-abb9-3c05d7309647 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.402000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dde39f-fc2a-4518-abb9-3c05d7309647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.469406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-86dde39f-fc2a-4518-abb9-3c05d7309647 None None] MFA Rules not processed for user `bf02ab5a7b8c4c06b4049a6a200a1195`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:02.470614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-86dde39f-fc2a-4518-abb9-3c05d7309647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:02.566047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 659/1330] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:23:02.604214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0bb34-f345-44d2-9cca-4cb5ff17a769 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:02.606106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e2d0bb34-f345-44d2-9cca-4cb5ff17a769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:02.712910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0bb34-f345-44d2-9cca-4cb5ff17a769 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:02.786615 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0220c6-8d34-45eb-8fbf-47b8076f383d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:02.787298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0220c6-8d34-45eb-8fbf-47b8076f383d service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:02.787578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0220c6-8d34-45eb-8fbf-47b8076f383d service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:02.787849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0220c6-8d34-45eb-8fbf-47b8076f383d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:02.789498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-eb0220c6-8d34-45eb-8fbf-47b8076f383d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:02.903144 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0220c6-8d34-45eb-8fbf-47b8076f383d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:02.904599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0220c6-8d34-45eb-8fbf-47b8076f383d service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:02.922589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 672/1331] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:05.434866 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62881c7b-5c26-4c26-bf7e-6cd422f32964 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.435489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62881c7b-5c26-4c26-bf7e-6cd422f32964 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.435489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62881c7b-5c26-4c26-bf7e-6cd422f32964 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.436904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 660/1332] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:05.442592 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eb92e-da71-4253-9783-76ae1a4fdf13 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.443142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eb92e-da71-4253-9783-76ae1a4fdf13 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.443245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2eb92e-da71-4253-9783-76ae1a4fdf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.512166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-cb2eb92e-da71-4253-9783-76ae1a4fdf13 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:05.513291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cb2eb92e-da71-4253-9783-76ae1a4fdf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:05.609131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 673/1333] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:05.646102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62881c7b-5c26-4c26-bf7e-6cd422f32964 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:05.647716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-62881c7b-5c26-4c26-bf7e-6cd422f32964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:05.756019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62881c7b-5c26-4c26-bf7e-6cd422f32964 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:05.830239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95474ffb-b75b-474c-929e-3f9e286cedb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:05.830900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95474ffb-b75b-474c-929e-3f9e286cedb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:05.831227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95474ffb-b75b-474c-929e-3f9e286cedb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:05.831505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95474ffb-b75b-474c-929e-3f9e286cedb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:05.833171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-95474ffb-b75b-474c-929e-3f9e286cedb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:05.942311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95474ffb-b75b-474c-929e-3f9e286cedb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:05.943779 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95474ffb-b75b-474c-929e-3f9e286cedb4 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:05.962325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 661/1334] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:08.319068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73dcb8-de8f-4b8a-8062-60bea57fff3e None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:08.319587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73dcb8-de8f-4b8a-8062-60bea57fff3e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:08.319707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73dcb8-de8f-4b8a-8062-60bea57fff3e None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:08.321089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 674/1335] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:08.326460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4b26-f811-496a-83cd-36536de01ae9 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:08.326926 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4b26-f811-496a-83cd-36536de01ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:08.327055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4b26-f811-496a-83cd-36536de01ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:08.392729 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-643a4b26-f811-496a-83cd-36536de01ae9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:08.394050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-643a4b26-f811-496a-83cd-36536de01ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:08.504123 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 662/1336] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:08.545066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73dcb8-de8f-4b8a-8062-60bea57fff3e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:08.546643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-ad73dcb8-de8f-4b8a-8062-60bea57fff3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:08.649671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73dcb8-de8f-4b8a-8062-60bea57fff3e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:08.721810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3444902-8bb2-4021-bd90-5715baae0580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:08.722456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444902-8bb2-4021-bd90-5715baae0580 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:08.722737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444902-8bb2-4021-bd90-5715baae0580 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:08.723009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3444902-8bb2-4021-bd90-5715baae0580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:08.724685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b3444902-8bb2-4021-bd90-5715baae0580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:08.840009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3444902-8bb2-4021-bd90-5715baae0580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:08.841430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3444902-8bb2-4021-bd90-5715baae0580 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:08.861617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 675/1337] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:11.398301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de6c87-85f1-4657-9655-fb66a432d6fa None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:11.398861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de6c87-85f1-4657-9655-fb66a432d6fa None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:11.398861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de6c87-85f1-4657-9655-fb66a432d6fa None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:11.400296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 663/1338] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:11.406330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86cacd-692e-4695-a1d4-3ec4b26dd946 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:11.406841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86cacd-692e-4695-a1d4-3ec4b26dd946 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:11.406947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86cacd-692e-4695-a1d4-3ec4b26dd946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:11.470509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-4e86cacd-692e-4695-a1d4-3ec4b26dd946 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:11.471827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4e86cacd-692e-4695-a1d4-3ec4b26dd946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:11.566463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 676/1339] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:11.605712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de6c87-85f1-4657-9655-fb66a432d6fa None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:11.607278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-62de6c87-85f1-4657-9655-fb66a432d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:11.709354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de6c87-85f1-4657-9655-fb66a432d6fa None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:11.780202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9240a5-8380-4b52-9994-a6dd5f6ca59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:11.780858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9240a5-8380-4b52-9994-a6dd5f6ca59f service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:11.781138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9240a5-8380-4b52-9994-a6dd5f6ca59f service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:11.781407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9240a5-8380-4b52-9994-a6dd5f6ca59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:11.783094 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6a9240a5-8380-4b52-9994-a6dd5f6ca59f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:11.898987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9240a5-8380-4b52-9994-a6dd5f6ca59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:11.900620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9240a5-8380-4b52-9994-a6dd5f6ca59f service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:11.920048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 664/1340] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:16.237499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d067d-a795-4469-8421-27c66e2ab84b None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:16.238103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d067d-a795-4469-8421-27c66e2ab84b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:16.238103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d067d-a795-4469-8421-27c66e2ab84b None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:16.239762 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 677/1341] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:16.245178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4455cd-7cb0-4df2-9bf9-7933a5723615 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:16.245685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4455cd-7cb0-4df2-9bf9-7933a5723615 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:16.245800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4455cd-7cb0-4df2-9bf9-7933a5723615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:16.321462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-db4455cd-7cb0-4df2-9bf9-7933a5723615 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:16.322689 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-db4455cd-7cb0-4df2-9bf9-7933a5723615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:16.436303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 665/1342] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:16.481998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d067d-a795-4469-8421-27c66e2ab84b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:16.484984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c77d067d-a795-4469-8421-27c66e2ab84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:16.585426 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d067d-a795-4469-8421-27c66e2ab84b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:16.589287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2faf4-cfad-468c-922a-e2960e93763d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:16.589953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2faf4-cfad-468c-922a-e2960e93763d service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:16.590235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2faf4-cfad-468c-922a-e2960e93763d service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:16.590513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2faf4-cfad-468c-922a-e2960e93763d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:16.600903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2faf4-cfad-468c-922a-e2960e93763d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:16.602368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2faf4-cfad-468c-922a-e2960e93763d service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:16.615092 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 678/1343] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:19.541576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd61c-5608-4691-9a5c-8f1d12421faa None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.542201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd61c-5608-4691-9a5c-8f1d12421faa None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.542201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd61c-5608-4691-9a5c-8f1d12421faa None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.543538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 666/1344] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:19.549322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7f2d-ffab-49d8-a4b2-0511664c87cf None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.549823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7f2d-ffab-49d8-a4b2-0511664c87cf None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.549823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c7f2d-ffab-49d8-a4b2-0511664c87cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.582685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-bd6c7f2d-ffab-49d8-a4b2-0511664c87cf None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:19.583934 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-bd6c7f2d-ffab-49d8-a4b2-0511664c87cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:19.663648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 679/1345] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:19.699614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bd61c-5608-4691-9a5c-8f1d12421faa None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:19.713951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bd61c-5608-4691-9a5c-8f1d12421faa None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:19.720878 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add32c9e-885a-4801-80be-2805017c833b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:19.721546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32c9e-885a-4801-80be-2805017c833b service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:19.721996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32c9e-885a-4801-80be-2805017c833b service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:19.722273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add32c9e-885a-4801-80be-2805017c833b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:19.733169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add32c9e-885a-4801-80be-2805017c833b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:19.734753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add32c9e-885a-4801-80be-2805017c833b service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:19.745446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 667/1346] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:24.122706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a655-0c4c-4401-918b-aace558662ef None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.123343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a655-0c4c-4401-918b-aace558662ef None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.123456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7a655-0c4c-4401-918b-aace558662ef None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.125382 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 680/1347] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:24.131302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575c90-1303-4120-80a3-c4aaf5b3a81e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.131780 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575c90-1303-4120-80a3-c4aaf5b3a81e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.131899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49575c90-1303-4120-80a3-c4aaf5b3a81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.150940 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-49575c90-1303-4120-80a3-c4aaf5b3a81e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:24.152185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-49575c90-1303-4120-80a3-c4aaf5b3a81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:24.160300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 668/1348] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:23:24.198864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7a655-0c4c-4401-918b-aace558662ef None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:24.209405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7a655-0c4c-4401-918b-aace558662ef None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:24.212949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45218852-53ac-47f6-ad0d-b7287be8d51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:24.213599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45218852-53ac-47f6-ad0d-b7287be8d51c service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:24.213879 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45218852-53ac-47f6-ad0d-b7287be8d51c service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:24.214153 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45218852-53ac-47f6-ad0d-b7287be8d51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:24.225284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45218852-53ac-47f6-ad0d-b7287be8d51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:24.226734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45218852-53ac-47f6-ad0d-b7287be8d51c service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:24.237635 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 681/1349] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:29.849670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de9916-8c87-48b8-b326-5f26f3d73e07 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:29.850677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de9916-8c87-48b8-b326-5f26f3d73e07 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:29.851201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de9916-8c87-48b8-b326-5f26f3d73e07 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:29.853213 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 669/1350] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:29.859270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd09597-f116-4a47-b6b6-6a5ec2e61702 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:29.859815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd09597-f116-4a47-b6b6-6a5ec2e61702 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:29.859986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd09597-f116-4a47-b6b6-6a5ec2e61702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:29.935186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-0fd09597-f116-4a47-b6b6-6a5ec2e61702 None None] MFA Rules not processed for user `3004f3e4a9854502be59119e17e04961`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:29.937286 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0fd09597-f116-4a47-b6b6-6a5ec2e61702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:30.039794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 682/1351] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:23:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:34.611074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2353c-45f7-4dbd-84aa-959f28606013 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.612096 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2353c-45f7-4dbd-84aa-959f28606013 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.612616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2353c-45f7-4dbd-84aa-959f28606013 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.614082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 670/1352] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:34.619496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1dd0-c3c4-49cd-ab8c-03fcfcbcd840 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:34.620001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1dd0-c3c4-49cd-ab8c-03fcfcbcd840 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:34.620086 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1dd0-c3c4-49cd-ab8c-03fcfcbcd840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:34.641316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e90f1dd0-c3c4-49cd-ab8c-03fcfcbcd840 None None] MFA Rules not processed for user `3004f3e4a9854502be59119e17e04961`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:34.642546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e90f1dd0-c3c4-49cd-ab8c-03fcfcbcd840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:34.652409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 683/1353] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:23:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:36.003000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f229-70ce-47ae-800c-a4e4f91e8215 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:36.003574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f229-70ce-47ae-800c-a4e4f91e8215 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:36.003574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8f229-70ce-47ae-800c-a4e4f91e8215 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:36.004953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 671/1354] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:36.012230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689fe8-4e91-498e-ba18-aea6d0dbc4fa None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:36.012757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689fe8-4e91-498e-ba18-aea6d0dbc4fa None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:36.012924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689fe8-4e91-498e-ba18-aea6d0dbc4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:36.035828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-cc689fe8-4e91-498e-ba18-aea6d0dbc4fa None None] MFA Rules not processed for user `3004f3e4a9854502be59119e17e04961`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:36.037056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cc689fe8-4e91-498e-ba18-aea6d0dbc4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:36.046410 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 684/1355] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:23:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:23:40.192858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36475762-5f0b-446f-8719-b20924061f2e None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:40.193366 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36475762-5f0b-446f-8719-b20924061f2e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:40.193366 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36475762-5f0b-446f-8719-b20924061f2e None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:40.194819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 672/1356] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:40.200315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e565c-0bbb-40e8-8c4e-7ae241484f05 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:40.200753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e565c-0bbb-40e8-8c4e-7ae241484f05 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:40.200867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e565c-0bbb-40e8-8c4e-7ae241484f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:40.218964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f67e565c-0bbb-40e8-8c4e-7ae241484f05 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:40.220308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f67e565c-0bbb-40e8-8c4e-7ae241484f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:40.229827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 685/1357] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:40.279765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade4686-1da1-42b3-b29f-9c81463cf783 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:40.280208 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade4686-1da1-42b3-b29f-9c81463cf783 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:40.280589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade4686-1da1-42b3-b29f-9c81463cf783 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:40.282086 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 673/1358] 10.222.0.75 () {54 vars in 961 bytes} [Thu May 12 14:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:40.287536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa767-d197-405a-9eff-57a1e254aa06 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:40.287821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa767-d197-405a-9eff-57a1e254aa06 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:40.288251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa767-d197-405a-9eff-57a1e254aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:40.338854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f3efa767-d197-405a-9eff-57a1e254aa06 None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:40.340133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f3efa767-d197-405a-9eff-57a1e254aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:40.427298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 686/1359] 10.222.0.75 () {58 vars in 1058 bytes} [Thu May 12 14:23:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:40.430081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade4686-1da1-42b3-b29f-9c81463cf783 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:40.444805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade4686-1da1-42b3-b29f-9c81463cf783 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:40.450327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9431b-e475-4888-96a9-815217bd9bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:40.451016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9431b-e475-4888-96a9-815217bd9bdf service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:40.451324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9431b-e475-4888-96a9-815217bd9bdf service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:40.451640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9431b-e475-4888-96a9-815217bd9bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:40.460359 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9431b-e475-4888-96a9-815217bd9bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:40.461951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9431b-e475-4888-96a9-815217bd9bdf service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:40.472321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 674/1360] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:42.922081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bbb87-c07f-4c63-abea-92c407cae7cc None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.922767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bbb87-c07f-4c63-abea-92c407cae7cc None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.923441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bbb87-c07f-4c63-abea-92c407cae7cc None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.926647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 687/1361] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:42.932156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc28690-4756-4a30-bc3b-01699a5ee228 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:42.932651 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc28690-4756-4a30-bc3b-01699a5ee228 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:42.932736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc28690-4756-4a30-bc3b-01699a5ee228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:42.951348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-7dc28690-4756-4a30-bc3b-01699a5ee228 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:42.952797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7dc28690-4756-4a30-bc3b-01699a5ee228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:42.967694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 675/1362] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:43.006599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bbb87-c07f-4c63-abea-92c407cae7cc None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:43.022078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bbb87-c07f-4c63-abea-92c407cae7cc None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:43.027811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d5f7d-e52c-496e-a738-b5173cc79df5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:43.028556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5f7d-e52c-496e-a738-b5173cc79df5 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:43.028941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5f7d-e52c-496e-a738-b5173cc79df5 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:43.029322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d5f7d-e52c-496e-a738-b5173cc79df5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:43.038070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d5f7d-e52c-496e-a738-b5173cc79df5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:43.039810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d5f7d-e52c-496e-a738-b5173cc79df5 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:43.050767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 688/1363] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:23:45.624509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844636c8-3de0-43c8-9214-c17148fd2749 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.625085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844636c8-3de0-43c8-9214-c17148fd2749 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.625171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844636c8-3de0-43c8-9214-c17148fd2749 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.626798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 676/1364] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:45.633623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd5af-241f-4356-8c41-f424093331c8 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.634165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd5af-241f-4356-8c41-f424093331c8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.634165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd5af-241f-4356-8c41-f424093331c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.655162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-552bd5af-241f-4356-8c41-f424093331c8 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:45.656365 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-552bd5af-241f-4356-8c41-f424093331c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:45.664982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 689/1365] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:45.710136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b661-1095-47fd-95de-1ac217e98b56 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.710420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b661-1095-47fd-95de-1ac217e98b56 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.710695 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65b661-1095-47fd-95de-1ac217e98b56 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.712299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 677/1366] 10.222.0.75 () {54 vars in 961 bytes} [Thu May 12 14:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:45.717723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e473e3-de8c-458f-bc7d-2861317acf6b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.718003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e473e3-de8c-458f-bc7d-2861317acf6b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.718274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e473e3-de8c-458f-bc7d-2861317acf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.740683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-24e473e3-de8c-458f-bc7d-2861317acf6b None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:45.744987 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-24e473e3-de8c-458f-bc7d-2861317acf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:45.764961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 690/1367] 10.222.0.75 () {58 vars in 1058 bytes} [Thu May 12 14:23:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:45.773274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65b661-1095-47fd-95de-1ac217e98b56 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:45.789274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65b661-1095-47fd-95de-1ac217e98b56 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:45.794542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a6d1ae-51ef-41b3-b49c-fce43dfbc7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:45.795220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6d1ae-51ef-41b3-b49c-fce43dfbc7e2 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:45.795728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6d1ae-51ef-41b3-b49c-fce43dfbc7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:45.796000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a6d1ae-51ef-41b3-b49c-fce43dfbc7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:45.804224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6d1ae-51ef-41b3-b49c-fce43dfbc7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:45.805802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a6d1ae-51ef-41b3-b49c-fce43dfbc7e2 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:45.815157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 678/1368] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:48.110825 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfadfb-874e-4b93-989a-5aa6fd3909e6 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.111406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfadfb-874e-4b93-989a-5aa6fd3909e6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.111406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfadfb-874e-4b93-989a-5aa6fd3909e6 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.112778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 691/1369] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:48.118131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea74a4-609f-461e-9e3d-88099cc992cc None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.118892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea74a4-609f-461e-9e3d-88099cc992cc None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.119210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea74a4-609f-461e-9e3d-88099cc992cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.137462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-86ea74a4-609f-461e-9e3d-88099cc992cc None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:48.138778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-86ea74a4-609f-461e-9e3d-88099cc992cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:48.147585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 679/1370] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:48.190589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfadfb-874e-4b93-989a-5aa6fd3909e6 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:48.205187 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfadfb-874e-4b93-989a-5aa6fd3909e6 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:48.210532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30067420-eac5-4751-a0cc-292cff058b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:48.211246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30067420-eac5-4751-a0cc-292cff058b90 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.211496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30067420-eac5-4751-a0cc-292cff058b90 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.211757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30067420-eac5-4751-a0cc-292cff058b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.220729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30067420-eac5-4751-a0cc-292cff058b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:48.222250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30067420-eac5-4751-a0cc-292cff058b90 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:48.231859 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 692/1371] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:48.453131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879e1f-1b28-4bf2-b943-8785b778130b None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.453418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879e1f-1b28-4bf2-b943-8785b778130b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.453881 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33879e1f-1b28-4bf2-b943-8785b778130b None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.455316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 680/1372] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:48.461308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c559df-cf8e-4bb9-ab74-d6673a4790d8 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.461602 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c559df-cf8e-4bb9-ab74-d6673a4790d8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.462059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c559df-cf8e-4bb9-ab74-d6673a4790d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.481742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a9c559df-cf8e-4bb9-ab74-d6673a4790d8 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:48.483330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a9c559df-cf8e-4bb9-ab74-d6673a4790d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:48.494413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 693/1373] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:48.769717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd68a2-1b71-4a67-baa8-90ed0f00b132 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.770003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd68a2-1b71-4a67-baa8-90ed0f00b132 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.770451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd68a2-1b71-4a67-baa8-90ed0f00b132 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.772266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 681/1374] 10.222.0.75 () {54 vars in 963 bytes} [Thu May 12 14:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:48.777538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbdd77-a3b6-4917-ad96-56970ac6dbe9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.777856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbdd77-a3b6-4917-ad96-56970ac6dbe9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.778142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbdd77-a3b6-4917-ad96-56970ac6dbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.829275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-bcfbdd77-a3b6-4917-ad96-56970ac6dbe9 None None] MFA Rules not processed for user `cbe18e038b414ef0956a4e8a86586b88`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:48.830624 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-bcfbdd77-a3b6-4917-ad96-56970ac6dbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:48.904208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 694/1375] 10.222.0.75 () {58 vars in 1060 bytes} [Thu May 12 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:48.906268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd68a2-1b71-4a67-baa8-90ed0f00b132 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:48.917099 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd68a2-1b71-4a67-baa8-90ed0f00b132 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:48.920811 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca03508-5637-4ad0-b8d9-5c2d23696616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:48.921538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca03508-5637-4ad0-b8d9-5c2d23696616 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:48.921879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca03508-5637-4ad0-b8d9-5c2d23696616 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:48.922224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca03508-5637-4ad0-b8d9-5c2d23696616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:48.931725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca03508-5637-4ad0-b8d9-5c2d23696616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:48.933390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca03508-5637-4ad0-b8d9-5c2d23696616 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:48.945167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 682/1376] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:23:50.536750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686be2d-8668-4af6-80d1-03aea841ddd3 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.537320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686be2d-8668-4af6-80d1-03aea841ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.537320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686be2d-8668-4af6-80d1-03aea841ddd3 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.538720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 695/1377] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:50.545304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ee4ba-68e5-427a-83c5-193e52e5e0ed None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.545304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ee4ba-68e5-427a-83c5-193e52e5e0ed None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.550339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ee4ba-68e5-427a-83c5-193e52e5e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.566992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-940ee4ba-68e5-427a-83c5-193e52e5e0ed None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:50.568275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-940ee4ba-68e5-427a-83c5-193e52e5e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:50.577863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 683/1378] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:50.622859 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686be2d-8668-4af6-80d1-03aea841ddd3 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:50.637506 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686be2d-8668-4af6-80d1-03aea841ddd3 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:50.643128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b487a-6090-40ea-a71d-cf127cd2bc2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:50.643790 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b487a-6090-40ea-a71d-cf127cd2bc2a service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:50.644071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b487a-6090-40ea-a71d-cf127cd2bc2a service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:50.644346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b487a-6090-40ea-a71d-cf127cd2bc2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:50.653248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b487a-6090-40ea-a71d-cf127cd2bc2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:50.655555 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b487a-6090-40ea-a71d-cf127cd2bc2a service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:50.667506 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 696/1379] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:52.959475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ab8a-c4a2-4c7b-8e80-bd9ca040d0a1 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.960529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ab8a-c4a2-4c7b-8e80-bd9ca040d0a1 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.961025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ab8a-c4a2-4c7b-8e80-bd9ca040d0a1 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.965911 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 684/1380] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:52.968316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58f66-77d7-4479-8cdd-125ae5344d77 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:52.968744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58f66-77d7-4479-8cdd-125ae5344d77 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:52.968868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e58f66-77d7-4479-8cdd-125ae5344d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:52.987487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-71e58f66-77d7-4479-8cdd-125ae5344d77 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:52.988669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-71e58f66-77d7-4479-8cdd-125ae5344d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:52.996429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 697/1381] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:53.040308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733ab8a-c4a2-4c7b-8e80-bd9ca040d0a1 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:53.054779 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733ab8a-c4a2-4c7b-8e80-bd9ca040d0a1 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:53.060341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0980e37-2854-4cab-8643-b0a2fd985e3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:53.061706 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980e37-2854-4cab-8643-b0a2fd985e3c service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:53.061995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980e37-2854-4cab-8643-b0a2fd985e3c service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:53.062278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980e37-2854-4cab-8643-b0a2fd985e3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:53.070447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0980e37-2854-4cab-8643-b0a2fd985e3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:53.072071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0980e37-2854-4cab-8643-b0a2fd985e3c service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:53.082315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 685/1382] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:55.379551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aac13-f8f9-4c58-be15-8ed9aba9b57c None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:55.380084 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aac13-f8f9-4c58-be15-8ed9aba9b57c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:55.380084 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33aac13-f8f9-4c58-be15-8ed9aba9b57c None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:55.381482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 698/1383] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:55.387401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bb43d-f5ff-4f57-8046-2ec18b10a234 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:55.387881 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bb43d-f5ff-4f57-8046-2ec18b10a234 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:55.387964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bb43d-f5ff-4f57-8046-2ec18b10a234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:55.406641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-e18bb43d-f5ff-4f57-8046-2ec18b10a234 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:55.407905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e18bb43d-f5ff-4f57-8046-2ec18b10a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:55.416161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 686/1384] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:23:55.462006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33aac13-f8f9-4c58-be15-8ed9aba9b57c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:55.481441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33aac13-f8f9-4c58-be15-8ed9aba9b57c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:55.489253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6542a1-d287-4335-877c-4f4863c6d3ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:55.490055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6542a1-d287-4335-877c-4f4863c6d3ea service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:55.491460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6542a1-d287-4335-877c-4f4863c6d3ea service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:55.491460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6542a1-d287-4335-877c-4f4863c6d3ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:55.500771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6542a1-d287-4335-877c-4f4863c6d3ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:55.502628 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6542a1-d287-4335-877c-4f4863c6d3ea service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:55.515300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 699/1385] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:23:58.010903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c3d19-9eec-4000-afc2-f3890b283faa None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.011482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c3d19-9eec-4000-afc2-f3890b283faa None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.011482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c3d19-9eec-4000-afc2-f3890b283faa None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.013144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 687/1386] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:23:58.019490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f61bd-1135-4b6b-b82b-fe7549bd7d52 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.019980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f61bd-1135-4b6b-b82b-fe7549bd7d52 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.020100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f61bd-1135-4b6b-b82b-fe7549bd7d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.039000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-585f61bd-1135-4b6b-b82b-fe7549bd7d52 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:23:58.040236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-585f61bd-1135-4b6b-b82b-fe7549bd7d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:23:58.048632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 700/1387] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:23:58.098924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c3d19-9eec-4000-afc2-f3890b283faa None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:23:58.114073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c3d19-9eec-4000-afc2-f3890b283faa None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:23:58.119834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd42d19-b302-4614-b11c-c5c62e54a7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:23:58.120485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd42d19-b302-4614-b11c-c5c62e54a7e7 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:23:58.120775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd42d19-b302-4614-b11c-c5c62e54a7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:23:58.121063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd42d19-b302-4614-b11c-c5c62e54a7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:23:58.130568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd42d19-b302-4614-b11c-c5c62e54a7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:23:58.132353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd42d19-b302-4614-b11c-c5c62e54a7e7 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:23:58.143406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 688/1388] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:24:00.858743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1374d-46e9-4f6a-871e-0c07cb4c5f31 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.859513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1374d-46e9-4f6a-871e-0c07cb4c5f31 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.859513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1374d-46e9-4f6a-871e-0c07cb4c5f31 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.860817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 701/1389] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:00.866341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeee46-57d8-43e8-a7b0-13f1ba5d8714 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.866915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeee46-57d8-43e8-a7b0-13f1ba5d8714 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.867021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eeee46-57d8-43e8-a7b0-13f1ba5d8714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.884903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-a4eeee46-57d8-43e8-a7b0-13f1ba5d8714 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:00.886100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a4eeee46-57d8-43e8-a7b0-13f1ba5d8714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:00.894845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 689/1390] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:24:00.941046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1374d-46e9-4f6a-871e-0c07cb4c5f31 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:00.956453 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1374d-46e9-4f6a-871e-0c07cb4c5f31 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:00.962133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79cfdd-324b-49c2-882f-107776fc6c50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:00.962785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79cfdd-324b-49c2-882f-107776fc6c50 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:00.963093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79cfdd-324b-49c2-882f-107776fc6c50 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:00.963371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79cfdd-324b-49c2-882f-107776fc6c50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:00.972690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79cfdd-324b-49c2-882f-107776fc6c50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:00.974274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79cfdd-324b-49c2-882f-107776fc6c50 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:00.983930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 702/1391] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:03.615752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f64fe-59c3-4e56-a99e-142154cba38f None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:03.616242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f64fe-59c3-4e56-a99e-142154cba38f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:03.616349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f64fe-59c3-4e56-a99e-142154cba38f None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:03.617682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 690/1392] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:03.623162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f456d61-6e44-4e46-be23-a66f1ddb8cb6 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:03.624179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f456d61-6e44-4e46-be23-a66f1ddb8cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:03.624293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f456d61-6e44-4e46-be23-a66f1ddb8cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:03.642440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-8f456d61-6e44-4e46-be23-a66f1ddb8cb6 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:03.643649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8f456d61-6e44-4e46-be23-a66f1ddb8cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:03.651663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 703/1393] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:03.695243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f64fe-59c3-4e56-a99e-142154cba38f None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:03.709943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f64fe-59c3-4e56-a99e-142154cba38f None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:03.715681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d00170-9b1e-4b6b-8f6e-44c6628a3a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:03.716337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d00170-9b1e-4b6b-8f6e-44c6628a3a48 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:03.716613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d00170-9b1e-4b6b-8f6e-44c6628a3a48 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:03.716918 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d00170-9b1e-4b6b-8f6e-44c6628a3a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:03.725222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d00170-9b1e-4b6b-8f6e-44c6628a3a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:03.726802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d00170-9b1e-4b6b-8f6e-44c6628a3a48 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:03.736730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 691/1394] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:04.871124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aba262-1e88-4c54-b9cb-78bf3978bf29 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.871698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aba262-1e88-4c54-b9cb-78bf3978bf29 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.871698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aba262-1e88-4c54-b9cb-78bf3978bf29 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:04.873062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 704/1395] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:04.878479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3344ab5-05eb-49d4-aac7-c0e083a36494 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.878908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3344ab5-05eb-49d4-aac7-c0e083a36494 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.879017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3344ab5-05eb-49d4-aac7-c0e083a36494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:04.898089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-f3344ab5-05eb-49d4-aac7-c0e083a36494 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:04.899379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f3344ab5-05eb-49d4-aac7-c0e083a36494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:04.908034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 692/1396] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:04.965663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd7b0-4d5a-495b-ac87-16f0e5165234 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.965958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd7b0-4d5a-495b-ac87-16f0e5165234 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.966293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd7b0-4d5a-495b-ac87-16f0e5165234 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:04.968203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 705/1397] 10.222.0.75 () {54 vars in 962 bytes} [Thu May 12 14:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:04.973211 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776868a8-c317-4c23-b3ae-e181e1512690 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:04.973505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776868a8-c317-4c23-b3ae-e181e1512690 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:04.973782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776868a8-c317-4c23-b3ae-e181e1512690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.021593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-776868a8-c317-4c23-b3ae-e181e1512690 None None] MFA Rules not processed for user `10414e35df26406786eaf49c52661cee`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:05.022790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-776868a8-c317-4c23-b3ae-e181e1512690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:05.080847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 693/1398] 10.222.0.75 () {58 vars in 1059 bytes} [Thu May 12 14:24:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:05.088329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dd7b0-4d5a-495b-ac87-16f0e5165234 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.101435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dd7b0-4d5a-495b-ac87-16f0e5165234 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:05.105973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186350cf-3d81-4542-86af-081a0ac9f561 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10414e35df26406786eaf49c52661cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.106738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186350cf-3d81-4542-86af-081a0ac9f561 service glance] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.107023 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186350cf-3d81-4542-86af-081a0ac9f561 service glance] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.109108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186350cf-3d81-4542-86af-081a0ac9f561 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.119492 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186350cf-3d81-4542-86af-081a0ac9f561 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.121458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186350cf-3d81-4542-86af-081a0ac9f561 service glance] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.136396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 706/1399] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:05.569287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358cb35-7115-413a-a0b5-fef8b6c0a3a9 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.569583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358cb35-7115-413a-a0b5-fef8b6c0a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.569867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358cb35-7115-413a-a0b5-fef8b6c0a3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.619246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-8358cb35-7115-413a-a0b5-fef8b6c0a3a9 None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:05.620460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8358cb35-7115-413a-a0b5-fef8b6c0a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:05.683985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 694/1400] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:24:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:05.728705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614367-6f66-491b-84a7-1c9536924cce None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.729073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614367-6f66-491b-84a7-1c9536924cce None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.729453 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30614367-6f66-491b-84a7-1c9536924cce None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.730915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 707/1401] 10.222.0.75 () {54 vars in 942 bytes} [Thu May 12 14:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:05.737334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7fe26-011c-47de-8351-a528241b4657 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.737630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7fe26-011c-47de-8351-a528241b4657 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.737913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7fe26-011c-47de-8351-a528241b4657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.785493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2cb7fe26-011c-47de-8351-a528241b4657 None None] MFA Rules not processed for user `2893125208864a1ab2c32e50d5da3f83`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:05.786694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2cb7fe26-011c-47de-8351-a528241b4657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:05.857101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 695/1402] 10.222.0.75 () {58 vars in 1039 bytes} [Thu May 12 14:24:05 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:24:05.867579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614367-6f66-491b-84a7-1c9536924cce None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:05.880983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30614367-6f66-491b-84a7-1c9536924cce None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:05.886803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3b9c9-daa3-4042-af59-f2c1840799fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:05.887716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b9c9-daa3-4042-af59-f2c1840799fb service swift] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:05.888168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b9c9-daa3-4042-af59-f2c1840799fb service swift] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:05.888304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3b9c9-daa3-4042-af59-f2c1840799fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:05.897245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3b9c9-daa3-4042-af59-f2c1840799fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:05.898825 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3b9c9-daa3-4042-af59-f2c1840799fb service swift] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:05.907935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 708/1403] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:24:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:24:06.033248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8a5c-e723-427f-8f54-8a97cf743717 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:06.033750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8a5c-e723-427f-8f54-8a97cf743717 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:06.033847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8a5c-e723-427f-8f54-8a97cf743717 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:06.039236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 696/1404] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:24:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:06.040832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c7ba0-d48b-4319-94a2-2b2c0e197da9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:06.041116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c7ba0-d48b-4319-94a2-2b2c0e197da9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:06.041396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c7ba0-d48b-4319-94a2-2b2c0e197da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:06.061735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-8d2c7ba0-d48b-4319-94a2-2b2c0e197da9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:06.062944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8d2c7ba0-d48b-4319-94a2-2b2c0e197da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:06.072188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 709/1405] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:06.115898 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e8a5c-e723-427f-8f54-8a97cf743717 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:06.130827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e8a5c-e723-427f-8f54-8a97cf743717 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:06.136447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5ac16-7b9f-4843-a8f5-0c233e63bbdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:06.137351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ac16-7b9f-4843-a8f5-0c233e63bbdc service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:06.137636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ac16-7b9f-4843-a8f5-0c233e63bbdc service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:06.137916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5ac16-7b9f-4843-a8f5-0c233e63bbdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:06.150219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5ac16-7b9f-4843-a8f5-0c233e63bbdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:06.151900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5ac16-7b9f-4843-a8f5-0c233e63bbdc service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:06.162329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 697/1406] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:08.438026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebebb01-b1da-4199-8ef8-fa7c1383de0f None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.438621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebebb01-b1da-4199-8ef8-fa7c1383de0f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.438621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebebb01-b1da-4199-8ef8-fa7c1383de0f None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.440128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 710/1407] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:08.446294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d20b-5fae-4392-bb90-9c93e959741e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.446793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d20b-5fae-4392-bb90-9c93e959741e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.446893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d20b-5fae-4392-bb90-9c93e959741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.465913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5386d20b-5fae-4392-bb90-9c93e959741e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:08.467167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5386d20b-5fae-4392-bb90-9c93e959741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:08.476113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 698/1408] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:24:08.520364 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebebb01-b1da-4199-8ef8-fa7c1383de0f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:08.535623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebebb01-b1da-4199-8ef8-fa7c1383de0f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:08.543574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035a133-c3bb-4a93-817d-360d1c775049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:08.544328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a133-c3bb-4a93-817d-360d1c775049 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:08.544685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a133-c3bb-4a93-817d-360d1c775049 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:08.545036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035a133-c3bb-4a93-817d-360d1c775049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:08.554477 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035a133-c3bb-4a93-817d-360d1c775049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:08.556180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035a133-c3bb-4a93-817d-360d1c775049 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:08.566588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 711/1409] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:29.688320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab34cf-50c5-459c-b06b-b2e3ba41de5b None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.688963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab34cf-50c5-459c-b06b-b2e3ba41de5b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.689073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab34cf-50c5-459c-b06b-b2e3ba41de5b None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.690745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 699/1410] 10.222.0.75 () {54 vars in 918 bytes} [Thu May 12 14:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:29.696901 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d368b9-57a1-4c4f-bc48-708bad3a5741 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.697366 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d368b9-57a1-4c4f-bc48-708bad3a5741 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.697480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d368b9-57a1-4c4f-bc48-708bad3a5741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.715778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-01d368b9-57a1-4c4f-bc48-708bad3a5741 None None] MFA Rules not processed for user `3004f3e4a9854502be59119e17e04961`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:29.717042 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-01d368b9-57a1-4c4f-bc48-708bad3a5741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:29.727488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 712/1411] 10.222.0.75 () {58 vars in 1015 bytes} [Thu May 12 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:29.749516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f26f-9de8-4655-91cc-0bf5f8cbc7bf None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.749860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f26f-9de8-4655-91cc-0bf5f8cbc7bf None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.750194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6f26f-9de8-4655-91cc-0bf5f8cbc7bf None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.751941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 700/1412] 10.222.0.75 () {54 vars in 918 bytes} [Thu May 12 14:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:29.756690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab4413-37b4-4ac5-ba81-fc8d6326921b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:29.756988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab4413-37b4-4ac5-ba81-fc8d6326921b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:29.757260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab4413-37b4-4ac5-ba81-fc8d6326921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:29.775607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-26ab4413-37b4-4ac5-ba81-fc8d6326921b None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:29.776816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-26ab4413-37b4-4ac5-ba81-fc8d6326921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:29.786099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 713/1413] 10.222.0.75 () {58 vars in 1015 bytes} [Thu May 12 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:32.510772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07295-8c43-401b-a0e4-2332af101d2e None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:32.511409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07295-8c43-401b-a0e4-2332af101d2e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:32.511409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07295-8c43-401b-a0e4-2332af101d2e None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:32.512981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:32.518289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0f42-9cea-4cd8-8721-74e4dcc2c3f4 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:32.518703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0f42-9cea-4cd8-8721-74e4dcc2c3f4 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:32.518850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0f0f42-9cea-4cd8-8721-74e4dcc2c3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:32.536132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-7a0f0f42-9cea-4cd8-8721-74e4dcc2c3f4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:32.537327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7a0f0f42-9cea-4cd8-8721-74e4dcc2c3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:32.545661 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:32.586819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07295-8c43-401b-a0e4-2332af101d2e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:32.601219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07295-8c43-401b-a0e4-2332af101d2e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:32.606582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f1898-b746-4685-9fae-dfc0e4aac662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:32.607247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1898-b746-4685-9fae-dfc0e4aac662 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:32.607582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1898-b746-4685-9fae-dfc0e4aac662 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:32.608439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1898-b746-4685-9fae-dfc0e4aac662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:32.616428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f1898-b746-4685-9fae-dfc0e4aac662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:32.618021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f1898-b746-4685-9fae-dfc0e4aac662 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:32.627149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 702/1416] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:33.628346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ea239-c6dc-4867-bf1f-a73802a1a566 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.628902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ea239-c6dc-4867-bf1f-a73802a1a566 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.628902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ea239-c6dc-4867-bf1f-a73802a1a566 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.630266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:33.635350 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431afe0-d469-46f0-b8d1-626ee5606ab2 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.635829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431afe0-d469-46f0-b8d1-626ee5606ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.635965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431afe0-d469-46f0-b8d1-626ee5606ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.654137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-4431afe0-d469-46f0-b8d1-626ee5606ab2 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:33.655349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4431afe0-d469-46f0-b8d1-626ee5606ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:33.663265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:33.814234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ea239-c6dc-4867-bf1f-a73802a1a566 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:33.828955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ea239-c6dc-4867-bf1f-a73802a1a566 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:33.834313 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc36e3d-6440-44f1-b53f-0adc0cebf345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:33.834937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc36e3d-6440-44f1-b53f-0adc0cebf345 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:33.835249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc36e3d-6440-44f1-b53f-0adc0cebf345 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:33.835525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc36e3d-6440-44f1-b53f-0adc0cebf345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:33.843804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc36e3d-6440-44f1-b53f-0adc0cebf345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:33.845380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc36e3d-6440-44f1-b53f-0adc0cebf345 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:33.854754 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 716/1419] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:34.805764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859a43-45f6-4a6d-9e2d-b88c7291104e None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.806303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859a43-45f6-4a6d-9e2d-b88c7291104e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.806303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a859a43-45f6-4a6d-9e2d-b88c7291104e None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.807678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:34.812685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdff5df-6597-4648-9f86-6054dc12cd5c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:34.813115 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdff5df-6597-4648-9f86-6054dc12cd5c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:34.813251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdff5df-6597-4648-9f86-6054dc12cd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:34.831746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6cdff5df-6597-4648-9f86-6054dc12cd5c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:34.832963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6cdff5df-6597-4648-9f86-6054dc12cd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:34.840758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:34.989881 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859a43-45f6-4a6d-9e2d-b88c7291104e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:35.007611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a859a43-45f6-4a6d-9e2d-b88c7291104e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:35.013364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c899bb4-d82f-4aee-ae38-451e4c0dee7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:35.014566 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c899bb4-d82f-4aee-ae38-451e4c0dee7d service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.014849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c899bb4-d82f-4aee-ae38-451e4c0dee7d service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.015169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c899bb4-d82f-4aee-ae38-451e4c0dee7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.023400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c899bb4-d82f-4aee-ae38-451e4c0dee7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:35.024985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c899bb4-d82f-4aee-ae38-451e4c0dee7d service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:35.034432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 705/1422] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:35.972728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52795c3b-cd9f-4cec-a56a-cbd023bfe731 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.973289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52795c3b-cd9f-4cec-a56a-cbd023bfe731 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.973289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52795c3b-cd9f-4cec-a56a-cbd023bfe731 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.974685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:24:35.979778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082495ad-eb56-4836-9504-e72c43dd4f26 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:35.980204 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082495ad-eb56-4836-9504-e72c43dd4f26 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:35.980326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082495ad-eb56-4836-9504-e72c43dd4f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:35.999427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-082495ad-eb56-4836-9504-e72c43dd4f26 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:36.000631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-082495ad-eb56-4836-9504-e72c43dd4f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:36.009176 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:36.167995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52795c3b-cd9f-4cec-a56a-cbd023bfe731 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:36.186166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52795c3b-cd9f-4cec-a56a-cbd023bfe731 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:36.193195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25414947-7ff6-4692-8eb8-9bbd8dc67541 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:36.194056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414947-7ff6-4692-8eb8-9bbd8dc67541 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:36.194427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414947-7ff6-4692-8eb8-9bbd8dc67541 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:36.194828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414947-7ff6-4692-8eb8-9bbd8dc67541 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:36.205493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25414947-7ff6-4692-8eb8-9bbd8dc67541 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:36.207551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25414947-7ff6-4692-8eb8-9bbd8dc67541 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:36.220390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 719/1425] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:37.184996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c460a-e3ef-4cfe-9681-1a063fe00679 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:37.185615 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c460a-e3ef-4cfe-9681-1a063fe00679 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:37.185615 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c460a-e3ef-4cfe-9681-1a063fe00679 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:37.186963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:37.191846 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b160a12-c15b-417d-b2f1-6729bc511d7b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:37.192261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b160a12-c15b-417d-b2f1-6729bc511d7b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:37.192411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b160a12-c15b-417d-b2f1-6729bc511d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:37.209852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-7b160a12-c15b-417d-b2f1-6729bc511d7b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:37.211069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7b160a12-c15b-417d-b2f1-6729bc511d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:37.219490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:37.369506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c460a-e3ef-4cfe-9681-1a063fe00679 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:37.383879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c460a-e3ef-4cfe-9681-1a063fe00679 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:37.389616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ee145-5241-4c29-8c7e-8bc139f145d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:37.390266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee145-5241-4c29-8c7e-8bc139f145d4 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:37.390533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee145-5241-4c29-8c7e-8bc139f145d4 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:37.390803 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ee145-5241-4c29-8c7e-8bc139f145d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:37.398877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ee145-5241-4c29-8c7e-8bc139f145d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:37.400486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ee145-5241-4c29-8c7e-8bc139f145d4 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:37.410315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 708/1428] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:38.303592 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a2ae-6a57-4950-93f6-4926e1ce9506 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.304256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a2ae-6a57-4950-93f6-4926e1ce9506 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.304256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a2ae-6a57-4950-93f6-4926e1ce9506 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.305437 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:38.310377 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658af4-c597-4195-aa9f-90af1447e9ff None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.311498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658af4-c597-4195-aa9f-90af1447e9ff None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.311498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0658af4-c597-4195-aa9f-90af1447e9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.329196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-a0658af4-c597-4195-aa9f-90af1447e9ff None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:38.330410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a0658af4-c597-4195-aa9f-90af1447e9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:38.338020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:38.492694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a2ae-6a57-4950-93f6-4926e1ce9506 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:38.507355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a2ae-6a57-4950-93f6-4926e1ce9506 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:38.512852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad9152-71eb-453b-bf8b-cbf032db502f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:38.513482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9152-71eb-453b-bf8b-cbf032db502f service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:38.513775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9152-71eb-453b-bf8b-cbf032db502f service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:38.514046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad9152-71eb-453b-bf8b-cbf032db502f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:38.522147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad9152-71eb-453b-bf8b-cbf032db502f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:38.523830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad9152-71eb-453b-bf8b-cbf032db502f service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:38.533344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 722/1431] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:39.428476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b3ff7-3c8d-4adc-b6cb-7ba38ea4332e None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.429050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b3ff7-3c8d-4adc-b6cb-7ba38ea4332e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.429050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b3ff7-3c8d-4adc-b6cb-7ba38ea4332e None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.430419 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:39.435426 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95de89a-8a19-46dc-aed4-078645dc43e7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.436432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95de89a-8a19-46dc-aed4-078645dc43e7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.436538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95de89a-8a19-46dc-aed4-078645dc43e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.454733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c95de89a-8a19-46dc-aed4-078645dc43e7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:39.455966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c95de89a-8a19-46dc-aed4-078645dc43e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:39.464139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:24:39.613358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b3ff7-3c8d-4adc-b6cb-7ba38ea4332e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:39.633038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b3ff7-3c8d-4adc-b6cb-7ba38ea4332e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:39.640813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dcfe3-ef60-4640-8a87-511fa3034120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:39.641467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dcfe3-ef60-4640-8a87-511fa3034120 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:39.641749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dcfe3-ef60-4640-8a87-511fa3034120 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:39.642023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dcfe3-ef60-4640-8a87-511fa3034120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:39.650313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dcfe3-ef60-4640-8a87-511fa3034120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:39.651899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dcfe3-ef60-4640-8a87-511fa3034120 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:39.661770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 711/1434] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:40.567422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2923475-a096-4f67-85b5-2ad603a0eece None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.567995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2923475-a096-4f67-85b5-2ad603a0eece None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.567995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2923475-a096-4f67-85b5-2ad603a0eece None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.569353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:40.574388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755058b-4b8a-42c4-a734-d951ae2f2974 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.574845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755058b-4b8a-42c4-a734-d951ae2f2974 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.574952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755058b-4b8a-42c4-a734-d951ae2f2974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.592386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5755058b-4b8a-42c4-a734-d951ae2f2974 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:40.593575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5755058b-4b8a-42c4-a734-d951ae2f2974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:40.601435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:40.751409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2923475-a096-4f67-85b5-2ad603a0eece None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:40.765513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2923475-a096-4f67-85b5-2ad603a0eece None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:40.771020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6037b9-e24d-458d-9820-1236dfcc5f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:40.771671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6037b9-e24d-458d-9820-1236dfcc5f0c service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:40.771957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6037b9-e24d-458d-9820-1236dfcc5f0c service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:40.772231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6037b9-e24d-458d-9820-1236dfcc5f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:40.780353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6037b9-e24d-458d-9820-1236dfcc5f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:40.781970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6037b9-e24d-458d-9820-1236dfcc5f0c service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:40.791781 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 725/1437] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:24:41.675775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1e600-1c07-4688-91fe-da77bdcaed56 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.676363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1e600-1c07-4688-91fe-da77bdcaed56 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.676363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1e600-1c07-4688-91fe-da77bdcaed56 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.677716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:41.683058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08802714-2cba-4a5e-989d-b895d7fdeef3 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.683526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08802714-2cba-4a5e-989d-b895d7fdeef3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.683735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08802714-2cba-4a5e-989d-b895d7fdeef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.703316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-08802714-2cba-4a5e-989d-b895d7fdeef3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:41.704516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-08802714-2cba-4a5e-989d-b895d7fdeef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:41.713079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:41.859974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1e600-1c07-4688-91fe-da77bdcaed56 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:41.876470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1e600-1c07-4688-91fe-da77bdcaed56 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:41.882382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69273228-b6ec-4769-9a93-f2c756c0bf59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:41.883044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69273228-b6ec-4769-9a93-f2c756c0bf59 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:41.883338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69273228-b6ec-4769-9a93-f2c756c0bf59 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:41.883614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69273228-b6ec-4769-9a93-f2c756c0bf59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:41.896290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69273228-b6ec-4769-9a93-f2c756c0bf59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:41.897864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69273228-b6ec-4769-9a93-f2c756c0bf59 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:41.907222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 714/1440] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:44.024798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b26e5-7b3e-4c11-bfd3-9b822082d164 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.025333 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b26e5-7b3e-4c11-bfd3-9b822082d164 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.025454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b26e5-7b3e-4c11-bfd3-9b822082d164 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.026939 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:44.032238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e769fa-78b4-46e0-af3c-6923cc697685 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.032646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e769fa-78b4-46e0-af3c-6923cc697685 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.032801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e769fa-78b4-46e0-af3c-6923cc697685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.049953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-44e769fa-78b4-46e0-af3c-6923cc697685 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:44.051188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-44e769fa-78b4-46e0-af3c-6923cc697685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:44.058817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:44.097039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b26e5-7b3e-4c11-bfd3-9b822082d164 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:44.098781 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d90b26e5-7b3e-4c11-bfd3-9b822082d164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:44.111535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b26e5-7b3e-4c11-bfd3-9b822082d164 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:44.114961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749f1bb-ac59-4d9b-95ff-e28563379335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:44.115615 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f1bb-ac59-4d9b-95ff-e28563379335 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:44.115893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f1bb-ac59-4d9b-95ff-e28563379335 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:44.116165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f1bb-ac59-4d9b-95ff-e28563379335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:44.125610 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749f1bb-ac59-4d9b-95ff-e28563379335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:44.127081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749f1bb-ac59-4d9b-95ff-e28563379335 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:44.136769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 728/1443] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:46.628808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ffd8-25b6-4fb9-9b7f-c6678f3d7543 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.629404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ffd8-25b6-4fb9-9b7f-c6678f3d7543 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.629404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ffd8-25b6-4fb9-9b7f-c6678f3d7543 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.630766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:46.636321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292fe59-47fb-4a91-a702-73904d671cb5 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.636841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292fe59-47fb-4a91-a702-73904d671cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.636968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292fe59-47fb-4a91-a702-73904d671cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.654979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d292fe59-47fb-4a91-a702-73904d671cb5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:46.656245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d292fe59-47fb-4a91-a702-73904d671cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:46.664090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:46.702770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ffd8-25b6-4fb9-9b7f-c6678f3d7543 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:46.713337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ffd8-25b6-4fb9-9b7f-c6678f3d7543 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:46.716957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbe316-9535-4137-b155-99f3c687ef08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:46.717593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbe316-9535-4137-b155-99f3c687ef08 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:46.717875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbe316-9535-4137-b155-99f3c687ef08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:46.718150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbe316-9535-4137-b155-99f3c687ef08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:46.726825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbe316-9535-4137-b155-99f3c687ef08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:46.728296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbe316-9535-4137-b155-99f3c687ef08 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:46.737907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 717/1446] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:49.335982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14e20d-c923-4eba-abd7-17c1c825b389 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:49.336625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14e20d-c923-4eba-abd7-17c1c825b389 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:49.336732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14e20d-c923-4eba-abd7-17c1c825b389 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:49.338089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:49.343885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b05bf-dc67-4f7a-80b5-5d8b23d78323 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:49.344298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b05bf-dc67-4f7a-80b5-5d8b23d78323 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:49.344454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b05bf-dc67-4f7a-80b5-5d8b23d78323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:49.362220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-267b05bf-dc67-4f7a-80b5-5d8b23d78323 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:49.363447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-267b05bf-dc67-4f7a-80b5-5d8b23d78323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:49.371174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:49.410007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14e20d-c923-4eba-abd7-17c1c825b389 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:49.421282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14e20d-c923-4eba-abd7-17c1c825b389 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:49.424895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a74b8a-4c3a-490f-905c-e1c43a1630de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:49.425530 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a74b8a-4c3a-490f-905c-e1c43a1630de service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:49.425820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a74b8a-4c3a-490f-905c-e1c43a1630de service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:49.426100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a74b8a-4c3a-490f-905c-e1c43a1630de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:49.435175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a74b8a-4c3a-490f-905c-e1c43a1630de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:49.436703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a74b8a-4c3a-490f-905c-e1c43a1630de service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:49.446002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 731/1449] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:24:51.805829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe96f9-4627-4457-9b9f-b3bc4743e37b None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.806470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe96f9-4627-4457-9b9f-b3bc4743e37b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.806470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe96f9-4627-4457-9b9f-b3bc4743e37b None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.807909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:51.813772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8eb16-f928-4f3a-b3c9-67c559852af4 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.814200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8eb16-f928-4f3a-b3c9-67c559852af4 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.814327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8eb16-f928-4f3a-b3c9-67c559852af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.832693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-aaa8eb16-f928-4f3a-b3c9-67c559852af4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:51.833884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-aaa8eb16-f928-4f3a-b3c9-67c559852af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:51.843060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:51.884026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe96f9-4627-4457-9b9f-b3bc4743e37b None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:51.895844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe96f9-4627-4457-9b9f-b3bc4743e37b None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:51.899379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55625c-c649-48b5-8fd2-e33658f63750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:51.900012 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55625c-c649-48b5-8fd2-e33658f63750 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:51.900293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55625c-c649-48b5-8fd2-e33658f63750 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:51.900570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55625c-c649-48b5-8fd2-e33658f63750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:51.909223 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55625c-c649-48b5-8fd2-e33658f63750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:51.910640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55625c-c649-48b5-8fd2-e33658f63750 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:51.920365 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 720/1452] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:54.267686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfe532-6b8b-4d89-ae10-f789b8bf743e None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.268267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfe532-6b8b-4d89-ae10-f789b8bf743e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.268267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfe532-6b8b-4d89-ae10-f789b8bf743e None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.269509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:54.274980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc57bd-24a0-4972-929f-514faafdf81f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.275463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc57bd-24a0-4972-929f-514faafdf81f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.275662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc57bd-24a0-4972-929f-514faafdf81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.295241 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-dfdc57bd-24a0-4972-929f-514faafdf81f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:54.296462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-dfdc57bd-24a0-4972-929f-514faafdf81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:54.304287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:24:54.341420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfe532-6b8b-4d89-ae10-f789b8bf743e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:54.352800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfe532-6b8b-4d89-ae10-f789b8bf743e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:54.356382 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecddc4-2666-46db-9538-a7ed56ed8666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:54.357017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecddc4-2666-46db-9538-a7ed56ed8666 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:54.357302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecddc4-2666-46db-9538-a7ed56ed8666 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:54.357582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecddc4-2666-46db-9538-a7ed56ed8666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:54.366467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecddc4-2666-46db-9538-a7ed56ed8666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:54.368004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecddc4-2666-46db-9538-a7ed56ed8666 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:54.377893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 734/1455] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:56.661671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9f0e3-233a-4f44-ae80-47d02d5fe7c1 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.662224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9f0e3-233a-4f44-ae80-47d02d5fe7c1 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.662339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9f0e3-233a-4f44-ae80-47d02d5fe7c1 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.663664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:56.669056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416610f-92b2-4cc4-a91e-d74f1e4e5ae9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.669448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416610f-92b2-4cc4-a91e-d74f1e4e5ae9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.669620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416610f-92b2-4cc4-a91e-d74f1e4e5ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.687736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-4416610f-92b2-4cc4-a91e-d74f1e4e5ae9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:56.688944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4416610f-92b2-4cc4-a91e-d74f1e4e5ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:56.697110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:24:56.737160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9f0e3-233a-4f44-ae80-47d02d5fe7c1 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:56.749819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9f0e3-233a-4f44-ae80-47d02d5fe7c1 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:56.753451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8a491-09a1-4400-9154-139698e5d743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:56.754113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8a491-09a1-4400-9154-139698e5d743 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:56.754396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8a491-09a1-4400-9154-139698e5d743 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:56.754675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8a491-09a1-4400-9154-139698e5d743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:56.763872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8a491-09a1-4400-9154-139698e5d743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:56.765319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8a491-09a1-4400-9154-139698e5d743 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:56.774991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 723/1458] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:24:59.093814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f83069-9c6d-4a6d-b32b-2fc5a128dae2 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:59.094351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f83069-9c6d-4a6d-b32b-2fc5a128dae2 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:59.094471 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f83069-9c6d-4a6d-b32b-2fc5a128dae2 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:59.095886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:24:59.101489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6b1f-3936-41e8-b4cc-c853fdfe9c2c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:59.101954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6b1f-3936-41e8-b4cc-c853fdfe9c2c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:59.102063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f6b1f-3936-41e8-b4cc-c853fdfe9c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:59.120529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c81f6b1f-3936-41e8-b4cc-c853fdfe9c2c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:24:59.121718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c81f6b1f-3936-41e8-b4cc-c853fdfe9c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:24:59.130148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:24:59.167643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f83069-9c6d-4a6d-b32b-2fc5a128dae2 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:24:59.178511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f83069-9c6d-4a6d-b32b-2fc5a128dae2 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:24:59.182094 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886358b-f921-4e61-9f70-133ea8936f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:24:59.182732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886358b-f921-4e61-9f70-133ea8936f68 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:24:59.183014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886358b-f921-4e61-9f70-133ea8936f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:24:59.183317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886358b-f921-4e61-9f70-133ea8936f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:24:59.192767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886358b-f921-4e61-9f70-133ea8936f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:24:59.194201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886358b-f921-4e61-9f70-133ea8936f68 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:24:59.204297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 737/1461] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:25:01.490607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1ef13-9d0c-4ec0-8f65-14b93e0cf6cf None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.491526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1ef13-9d0c-4ec0-8f65-14b93e0cf6cf None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.491526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1ef13-9d0c-4ec0-8f65-14b93e0cf6cf None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.493058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:01.500293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd2abf-038a-492d-be41-32ca61f074d2 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.501490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd2abf-038a-492d-be41-32ca61f074d2 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.501990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd2abf-038a-492d-be41-32ca61f074d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.521224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-ebfd2abf-038a-492d-be41-32ca61f074d2 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:01.522662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-ebfd2abf-038a-492d-be41-32ca61f074d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:01.531068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:25:01.571483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1ef13-9d0c-4ec0-8f65-14b93e0cf6cf None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:01.582137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1ef13-9d0c-4ec0-8f65-14b93e0cf6cf None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:01.585616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7227a-6e44-4707-805e-da4ae35985a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:01.586252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7227a-6e44-4707-805e-da4ae35985a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:01.586536 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7227a-6e44-4707-805e-da4ae35985a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:01.586812 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7227a-6e44-4707-805e-da4ae35985a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:01.595544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7227a-6e44-4707-805e-da4ae35985a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:01.596972 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7227a-6e44-4707-805e-da4ae35985a2 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:01.606264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 726/1464] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:25:03.856298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c35868-c5db-45f8-826a-bf43f578d408 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:03.856871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c35868-c5db-45f8-826a-bf43f578d408 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:03.856871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c35868-c5db-45f8-826a-bf43f578d408 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:03.858781 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:03.864467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eee2b9-0283-4b5f-a923-934d4bb9e4f9 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:03.864925 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eee2b9-0283-4b5f-a923-934d4bb9e4f9 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:03.865145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eee2b9-0283-4b5f-a923-934d4bb9e4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:03.883320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-09eee2b9-0283-4b5f-a923-934d4bb9e4f9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:03.884519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-09eee2b9-0283-4b5f-a923-934d4bb9e4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:03.893248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:25:03.929890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c35868-c5db-45f8-826a-bf43f578d408 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:03.943272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c35868-c5db-45f8-826a-bf43f578d408 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:03.947498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e422f0-282d-41af-99d3-622c70b39247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:03.948133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e422f0-282d-41af-99d3-622c70b39247 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:03.948417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e422f0-282d-41af-99d3-622c70b39247 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:03.948719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e422f0-282d-41af-99d3-622c70b39247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:03.957703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e422f0-282d-41af-99d3-622c70b39247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:03.959332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e422f0-282d-41af-99d3-622c70b39247 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:03.968839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 740/1467] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:25:06.200704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792324-293c-4e00-8792-b6023a4ab14a None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:06.201360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792324-293c-4e00-8792-b6023a4ab14a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:06.201360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95792324-293c-4e00-8792-b6023a4ab14a None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:06.202632 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:06.208305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7c377-4f1c-4ad1-be50-e2d0b259ab5c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:06.208777 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7c377-4f1c-4ad1-be50-e2d0b259ab5c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:06.208886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7c377-4f1c-4ad1-be50-e2d0b259ab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:06.226076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-cbf7c377-4f1c-4ad1-be50-e2d0b259ab5c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:06.227235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cbf7c377-4f1c-4ad1-be50-e2d0b259ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:06.235510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:25:06.272440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95792324-293c-4e00-8792-b6023a4ab14a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:06.283194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95792324-293c-4e00-8792-b6023a4ab14a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:06.286727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846918f1-64ab-4289-8c47-dc4de13476be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:06.287538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846918f1-64ab-4289-8c47-dc4de13476be service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:06.287824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846918f1-64ab-4289-8c47-dc4de13476be service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:06.288106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846918f1-64ab-4289-8c47-dc4de13476be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:06.297784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846918f1-64ab-4289-8c47-dc4de13476be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:06.299252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846918f1-64ab-4289-8c47-dc4de13476be service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:06.308638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 729/1470] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:25:39.882668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09420a1f-d146-486c-9852-5d66c7e3e6aa None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:39.883327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09420a1f-d146-486c-9852-5d66c7e3e6aa None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:39.883327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09420a1f-d146-486c-9852-5d66c7e3e6aa None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:39.884687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 742/1471] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:39.890817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17ba7a-4abc-4032-af03-e903bd2e7d70 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:39.891337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17ba7a-4abc-4032-af03-e903bd2e7d70 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:39.891576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17ba7a-4abc-4032-af03-e903bd2e7d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:39.909035 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-4b17ba7a-4abc-4032-af03-e903bd2e7d70 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:39.910245 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4b17ba7a-4abc-4032-af03-e903bd2e7d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:39.918060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 730/1472] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:25:39.965500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e485-89de-4302-9480-99830f0d7c84 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:39.965788 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e485-89de-4302-9480-99830f0d7c84 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:39.966064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7e485-89de-4302-9480-99830f0d7c84 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:39.967545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 743/1473] 10.222.0.75 () {54 vars in 962 bytes} [Thu May 12 14:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:39.972238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a33494-5144-4cb2-bc1b-3b19c591ce66 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:39.972532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a33494-5144-4cb2-bc1b-3b19c591ce66 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:39.972816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a33494-5144-4cb2-bc1b-3b19c591ce66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:39.991053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b6a33494-5144-4cb2-bc1b-3b19c591ce66 None None] MFA Rules not processed for user `10414e35df26406786eaf49c52661cee`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:39.992254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b6a33494-5144-4cb2-bc1b-3b19c591ce66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:39.999519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 731/1474] 10.222.0.75 () {58 vars in 1059 bytes} [Thu May 12 14:25:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:25:40.006583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7e485-89de-4302-9480-99830f0d7c84 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:40.017390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7e485-89de-4302-9480-99830f0d7c84 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:40.020911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394236e-3ae9-42b5-97a1-bc063b47bf7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10414e35df26406786eaf49c52661cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:40.021538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394236e-3ae9-42b5-97a1-bc063b47bf7f service glance] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:40.021824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394236e-3ae9-42b5-97a1-bc063b47bf7f service glance] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:40.022097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394236e-3ae9-42b5-97a1-bc063b47bf7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:40.030825 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394236e-3ae9-42b5-97a1-bc063b47bf7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:40.032304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394236e-3ae9-42b5-97a1-bc063b47bf7f service glance] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:40.041559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 744/1475] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:25:42.392267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b27105-bbb3-48af-8097-061cf151e392 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:42.392890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b27105-bbb3-48af-8097-061cf151e392 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:42.392890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b27105-bbb3-48af-8097-061cf151e392 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:42.394176 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 732/1476] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:25:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:42.399608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d4c59-dd70-407c-88f9-528857d6555f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:42.400087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d4c59-dd70-407c-88f9-528857d6555f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:42.400188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d4c59-dd70-407c-88f9-528857d6555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:42.417629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-4b7d4c59-dd70-407c-88f9-528857d6555f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:42.418842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4b7d4c59-dd70-407c-88f9-528857d6555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:42.426731 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 745/1477] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:25:42.450194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b27105-bbb3-48af-8097-061cf151e392 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:42.463220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b27105-bbb3-48af-8097-061cf151e392 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:42.467639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe39519-97a5-40b6-b03b-c9cecf881246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:42.468291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe39519-97a5-40b6-b03b-c9cecf881246 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:42.468574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe39519-97a5-40b6-b03b-c9cecf881246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:42.468846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe39519-97a5-40b6-b03b-c9cecf881246 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:42.469575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe39519-97a5-40b6-b03b-c9cecf881246 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:42.471740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WARNING py.warnings [None req-dbe39519-97a5-40b6-b03b-c9cecf881246 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:25:42.471740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: warnings.warn(msg) May 12 14:25:42.471740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: May 12 14:25:42.472565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe39519-97a5-40b6-b03b-c9cecf881246 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:42.491906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 733/1478] 10.222.0.75 () {56 vars in 1108 bytes} [Thu May 12 14:25:42 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:25:44.789455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120d7b2-cbaf-4bd4-9fd2-bc2ec4215fdf None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:44.790024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120d7b2-cbaf-4bd4-9fd2-bc2ec4215fdf None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:44.790024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120d7b2-cbaf-4bd4-9fd2-bc2ec4215fdf None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:44.791406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 746/1479] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:44.796648 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15290e8-5643-49de-9214-e5d33d1a24e1 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:44.797083 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15290e8-5643-49de-9214-e5d33d1a24e1 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:44.797200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15290e8-5643-49de-9214-e5d33d1a24e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:44.815186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-f15290e8-5643-49de-9214-e5d33d1a24e1 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:44.816396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f15290e8-5643-49de-9214-e5d33d1a24e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:44.824140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 734/1480] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:25:44.866062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120d7b2-cbaf-4bd4-9fd2-bc2ec4215fdf None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:44.880681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120d7b2-cbaf-4bd4-9fd2-bc2ec4215fdf None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:44.886266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b764f1-c7a8-4f63-90f5-163f2c08eb42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:44.886901 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b764f1-c7a8-4f63-90f5-163f2c08eb42 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:44.887224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b764f1-c7a8-4f63-90f5-163f2c08eb42 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:44.888390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b764f1-c7a8-4f63-90f5-163f2c08eb42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:44.897216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b764f1-c7a8-4f63-90f5-163f2c08eb42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:44.898809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b764f1-c7a8-4f63-90f5-163f2c08eb42 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:44.908065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 747/1481] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:25:47.331106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aafbb-567f-43b5-8e9d-64f5f7b5d208 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:47.331950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aafbb-567f-43b5-8e9d-64f5f7b5d208 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:47.331950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521aafbb-567f-43b5-8e9d-64f5f7b5d208 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:47.333221 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 735/1482] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:25:47.340036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03565e42-1a6a-4f08-979b-43ff6f36271c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:47.340582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03565e42-1a6a-4f08-979b-43ff6f36271c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:47.340582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03565e42-1a6a-4f08-979b-43ff6f36271c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:47.358959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-03565e42-1a6a-4f08-979b-43ff6f36271c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:47.360207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-03565e42-1a6a-4f08-979b-43ff6f36271c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:47.368056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 748/1483] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:25:47.407823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521aafbb-567f-43b5-8e9d-64f5f7b5d208 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:47.418383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521aafbb-567f-43b5-8e9d-64f5f7b5d208 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:47.421909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1a363-62bd-48ae-9428-b947590025aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:47.422549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1a363-62bd-48ae-9428-b947590025aa service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:47.422842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1a363-62bd-48ae-9428-b947590025aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:47.423150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1a363-62bd-48ae-9428-b947590025aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:47.436870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1a363-62bd-48ae-9428-b947590025aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:47.438320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1a363-62bd-48ae-9428-b947590025aa service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:47.447657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 736/1484] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:25:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:25:49.743551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f84f9-ed84-40f0-b719-ffa143b11d6e None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:49.744095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f84f9-ed84-40f0-b719-ffa143b11d6e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:49.744095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f84f9-ed84-40f0-b719-ffa143b11d6e None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:49.745501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 749/1485] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:49.750799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d360b1f-0a67-4ff8-a730-626fc187aec2 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:49.751271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d360b1f-0a67-4ff8-a730-626fc187aec2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:49.751389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d360b1f-0a67-4ff8-a730-626fc187aec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:49.770295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-4d360b1f-0a67-4ff8-a730-626fc187aec2 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:49.771529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4d360b1f-0a67-4ff8-a730-626fc187aec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:49.780047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 737/1486] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:25:49.817114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f84f9-ed84-40f0-b719-ffa143b11d6e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:49.828347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f84f9-ed84-40f0-b719-ffa143b11d6e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:49.831876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb171c-dd1b-4313-b1b8-2697ebe42e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:49.832506 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb171c-dd1b-4313-b1b8-2697ebe42e35 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:49.832797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb171c-dd1b-4313-b1b8-2697ebe42e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:49.833074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb171c-dd1b-4313-b1b8-2697ebe42e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:49.842742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb171c-dd1b-4313-b1b8-2697ebe42e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:49.844574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb171c-dd1b-4313-b1b8-2697ebe42e35 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:49.853881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 750/1487] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:25:52.307512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e3b39-775c-4d67-a9d7-b2199b0e9ea0 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:52.308074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e3b39-775c-4d67-a9d7-b2199b0e9ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:52.308074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e3b39-775c-4d67-a9d7-b2199b0e9ea0 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:52.309348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 738/1488] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:52.315055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e4748-22f0-4fb6-95de-c62d5a7d094f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:52.315475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e4748-22f0-4fb6-95de-c62d5a7d094f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:52.315722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e4748-22f0-4fb6-95de-c62d5a7d094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:52.333371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-443e4748-22f0-4fb6-95de-c62d5a7d094f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:52.334551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-443e4748-22f0-4fb6-95de-c62d5a7d094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:52.342241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 751/1489] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:25:52.382128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e3b39-775c-4d67-a9d7-b2199b0e9ea0 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:52.393521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e3b39-775c-4d67-a9d7-b2199b0e9ea0 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:52.397071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29eadb-a86d-4b50-9a77-fd473d8d3e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:52.397707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29eadb-a86d-4b50-9a77-fd473d8d3e1b service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:52.397995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29eadb-a86d-4b50-9a77-fd473d8d3e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:52.398273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29eadb-a86d-4b50-9a77-fd473d8d3e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:52.406981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29eadb-a86d-4b50-9a77-fd473d8d3e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:52.408429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29eadb-a86d-4b50-9a77-fd473d8d3e1b service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:52.417583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 739/1490] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:25:54.772501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfd55a-dcc0-40b5-a505-e361caf8f97b None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:54.773027 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfd55a-dcc0-40b5-a505-e361caf8f97b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:54.773027 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfd55a-dcc0-40b5-a505-e361caf8f97b None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:54.774335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 752/1491] 10.222.0.75 () {54 vars in 926 bytes} [Thu May 12 14:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:25:54.780287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a305-d1fe-4cb4-81d9-0290df1fa53b None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:54.780725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a305-d1fe-4cb4-81d9-0290df1fa53b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:54.780833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a305-d1fe-4cb4-81d9-0290df1fa53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:54.798122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-94a5a305-d1fe-4cb4-81d9-0290df1fa53b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:25:54.799393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-94a5a305-d1fe-4cb4-81d9-0290df1fa53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:25:54.807222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 740/1492] 10.222.0.75 () {58 vars in 1023 bytes} [Thu May 12 14:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:25:54.845825 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfd55a-dcc0-40b5-a505-e361caf8f97b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:25:54.856556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfd55a-dcc0-40b5-a505-e361caf8f97b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:25:54.860103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cda13c-2a5a-4a5e-a35b-1fb723c355a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:25:54.860731 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cda13c-2a5a-4a5e-a35b-1fb723c355a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:25:54.861016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cda13c-2a5a-4a5e-a35b-1fb723c355a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:25:54.861295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cda13c-2a5a-4a5e-a35b-1fb723c355a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:25:54.870125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cda13c-2a5a-4a5e-a35b-1fb723c355a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:25:54.871617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cda13c-2a5a-4a5e-a35b-1fb723c355a1 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:25:54.880683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 753/1493] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:25:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:27:22.541715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a1cc-2232-4e76-b91c-54dd1eec97b1 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:22.542754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a1cc-2232-4e76-b91c-54dd1eec97b1 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:22.542896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8a1cc-2232-4e76-b91c-54dd1eec97b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:22.561161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5cb8a1cc-2232-4e76-b91c-54dd1eec97b1 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:22.562355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5cb8a1cc-2232-4e76-b91c-54dd1eec97b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:22.570061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 741/1494] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:27:22.579516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3d3e8-d23d-466b-88b6-89aa7af3baf1 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:22.580035 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3d3e8-d23d-466b-88b6-89aa7af3baf1 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:22.580142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3d3e8-d23d-466b-88b6-89aa7af3baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:22.597343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e9e3d3e8-d23d-466b-88b6-89aa7af3baf1 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:22.598528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e9e3d3e8-d23d-466b-88b6-89aa7af3baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:22.607072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 754/1495] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:27:22.611540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8a1cc-2232-4e76-b91c-54dd1eec97b1 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:22.621825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8a1cc-2232-4e76-b91c-54dd1eec97b1 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:22.628287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32531e2a-19c1-4ca7-a554-5352362ec3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:22.628949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531e2a-19c1-4ca7-a554-5352362ec3fe admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:22.629234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531e2a-19c1-4ca7-a554-5352362ec3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:22.629511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531e2a-19c1-4ca7-a554-5352362ec3fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:22.630303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32531e2a-19c1-4ca7-a554-5352362ec3fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:27:22.630825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32531e2a-19c1-4ca7-a554-5352362ec3fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:22.632583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WARNING py.warnings [None req-32531e2a-19c1-4ca7-a554-5352362ec3fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:27:22.632583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: warnings.warn(msg) May 12 14:27:22.632583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: May 12 14:27:22.634125 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32531e2a-19c1-4ca7-a554-5352362ec3fe admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:22.647108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 742/1496] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:27:22.655445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3d3e8-d23d-466b-88b6-89aa7af3baf1 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:22.664478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3d3e8-d23d-466b-88b6-89aa7af3baf1 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:22.669545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a79b4-8d8f-461b-b334-f1a291aa657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:22.670194 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a79b4-8d8f-461b-b334-f1a291aa657b admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:22.670476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a79b4-8d8f-461b-b334-f1a291aa657b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:22.670751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a79b4-8d8f-461b-b334-f1a291aa657b admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:22.671490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a79b4-8d8f-461b-b334-f1a291aa657b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:22.673227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: WARNING py.warnings [None req-6c5a79b4-8d8f-461b-b334-f1a291aa657b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:27:22.673227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: warnings.warn(msg) May 12 14:27:22.673227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: May 12 14:27:22.674413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a79b4-8d8f-461b-b334-f1a291aa657b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:22.709860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 755/1497] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:27:22 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:27:22.714299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32531e2a-19c1-4ca7-a554-5352362ec3fe admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:22.724733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32531e2a-19c1-4ca7-a554-5352362ec3fe admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:22.780072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b74c1d-b68b-4075-aa93-eb717333138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:22.780666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b74c1d-b68b-4075-aa93-eb717333138a admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:22.780946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b74c1d-b68b-4075-aa93-eb717333138a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:22.781218 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b74c1d-b68b-4075-aa93-eb717333138a admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:22.781905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b74c1d-b68b-4075-aa93-eb717333138a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:22.782909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WARNING py.warnings [None req-54b74c1d-b68b-4075-aa93-eb717333138a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:27:22.782909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: warnings.warn(msg) May 12 14:27:22.782909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: May 12 14:27:22.784141 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b74c1d-b68b-4075-aa93-eb717333138a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:22.803878 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 743/1498] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:27:22 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:27:22.808671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a79b4-8d8f-461b-b334-f1a291aa657b admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:22.818600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a79b4-8d8f-461b-b334-f1a291aa657b admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:22.823152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed2c54-1bab-4367-ad52-ea2dc2a5d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:22.823800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed2c54-1bab-4367-ad52-ea2dc2a5d21b admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:22.824089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed2c54-1bab-4367-ad52-ea2dc2a5d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:22.824363 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed2c54-1bab-4367-ad52-ea2dc2a5d21b admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:22.825119 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed2c54-1bab-4367-ad52-ea2dc2a5d21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:22.826141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: WARNING py.warnings [None req-22ed2c54-1bab-4367-ad52-ea2dc2a5d21b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:27:22.826141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: warnings.warn(msg) May 12 14:27:22.826141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: May 12 14:27:22.827017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed2c54-1bab-4367-ad52-ea2dc2a5d21b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:22.839905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 756/1499] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:27:22.843915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b74c1d-b68b-4075-aa93-eb717333138a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:22.853684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b74c1d-b68b-4075-aa93-eb717333138a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:22.858745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc016cd-e191-4989-b766-f3c8b242d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:22.859440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc016cd-e191-4989-b766-f3c8b242d837 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:22.859726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc016cd-e191-4989-b766-f3c8b242d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:22.860034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc016cd-e191-4989-b766-f3c8b242d837 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:22.860759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc016cd-e191-4989-b766-f3c8b242d837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:22.861765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WARNING py.warnings [None req-bdc016cd-e191-4989-b766-f3c8b242d837 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:27:22.861765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: warnings.warn(msg) May 12 14:27:22.861765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: May 12 14:27:22.862647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc016cd-e191-4989-b766-f3c8b242d837 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:22.878303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 744/1500] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:27:22.882432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed2c54-1bab-4367-ad52-ea2dc2a5d21b admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:22.892380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed2c54-1bab-4367-ad52-ea2dc2a5d21b admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:22.896801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cefd7e-4b53-44e5-81b1-e193c49e159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:22.897698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cefd7e-4b53-44e5-81b1-e193c49e159b admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:22.897980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cefd7e-4b53-44e5-81b1-e193c49e159b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:22.898252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cefd7e-4b53-44e5-81b1-e193c49e159b admin admin] PATH_INFO: `/v3/projects/3f8cdb74f3f14bd6b52bac2d00ce625a/users/b6b29dd3ea3048cf8cd015c2c010efdb/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:22.912896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cefd7e-4b53-44e5-81b1-e193c49e159b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8cdb74f3f14bd6b52bac2d00ce625a, user_id=b6b29dd3ea3048cf8cd015c2c010efdb, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:22.913932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: WARNING py.warnings [None req-f6cefd7e-4b53-44e5-81b1-e193c49e159b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:27:22.913932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: warnings.warn(msg) May 12 14:27:22.913932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: May 12 14:27:22.916019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cefd7e-4b53-44e5-81b1-e193c49e159b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:22.932639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 757/1501] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:27:22 2022] PUT /identity/v3/projects/3f8cdb74f3f14bd6b52bac2d00ce625a/users/b6b29dd3ea3048cf8cd015c2c010efdb/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:27:22.944118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45a70-9833-49ce-988e-528564c65fd0 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:22.944415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45a70-9833-49ce-988e-528564c65fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:22.944699 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45a70-9833-49ce-988e-528564c65fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:22.971515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-d6a45a70-9833-49ce-988e-528564c65fd0 None None] MFA Rules not processed for user `b6b29dd3ea3048cf8cd015c2c010efdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:22.972722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d6a45a70-9833-49ce-988e-528564c65fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:23.034058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 745/1502] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:27:23.049940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4dea5-5ffc-4324-9d96-e6a59bbf8cd5 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.050233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4dea5-5ffc-4324-9d96-e6a59bbf8cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.050511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4dea5-5ffc-4324-9d96-e6a59bbf8cd5 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.051915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 758/1503] 10.222.0.75 () {54 vars in 963 bytes} [Thu May 12 14:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:23.056867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2aa5f-844f-4b6c-8bfe-48b74c39448e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.057160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2aa5f-844f-4b6c-8bfe-48b74c39448e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.057450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2aa5f-844f-4b6c-8bfe-48b74c39448e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.075121 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-90d2aa5f-844f-4b6c-8bfe-48b74c39448e None None] MFA Rules not processed for user `cbe18e038b414ef0956a4e8a86586b88`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:23.076333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-90d2aa5f-844f-4b6c-8bfe-48b74c39448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:23.126692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 746/1504] 10.222.0.75 () {58 vars in 1060 bytes} [Thu May 12 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:27:23.134530 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4dea5-5ffc-4324-9d96-e6a59bbf8cd5 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:23.144999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe4dea5-5ffc-4324-9d96-e6a59bbf8cd5 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:23.148442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0d9bd-87df-49fe-90b1-dc3855a902d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:23.149056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0d9bd-87df-49fe-90b1-dc3855a902d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.149336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0d9bd-87df-49fe-90b1-dc3855a902d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.149606 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0d9bd-87df-49fe-90b1-dc3855a902d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.158845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0d9bd-87df-49fe-90b1-dc3855a902d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:23.160391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf0d9bd-87df-49fe-90b1-dc3855a902d9 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:23.169619 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 759/1505] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:27:23.210103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd079a-85a8-47e9-9fad-81b6654badfc None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.210522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd079a-85a8-47e9-9fad-81b6654badfc None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.210805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd079a-85a8-47e9-9fad-81b6654badfc None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.212159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 747/1506] 10.222.0.75 () {52 vars in 829 bytes} [Thu May 12 14:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:27:23.216348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0d9bd-87df-49fe-90b1-dc3855a902d9 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:23.285242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0d9bd-87df-49fe-90b1-dc3855a902d9 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:23.289683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:23.290546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.290828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.291132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] PATH_INFO: `/v3/users/b6b29dd3ea3048cf8cd015c2c010efdb` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.292404 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b29dd3ea3048cf8cd015c2c010efdb)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:23.293429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: WARNING py.warnings [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:27:23.293429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: warnings.warn(msg) May 12 14:27:23.293429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: May 12 14:27:23.294631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:23.358974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b29dd3ea3048cf8cd015c2c010efdb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:27:23.371248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b29dd3ea3048cf8cd015c2c010efdb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:27:23.371943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b29dd3ea3048cf8cd015c2c010efdb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:27:23.372657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b29dd3ea3048cf8cd015c2c010efdb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:27:23.390903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b29dd3ea3048cf8cd015c2c010efdb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:27:23.406373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 760/1507] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:27:23 2022] DELETE /identity/v3/users/b6b29dd3ea3048cf8cd015c2c010efdb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:27:23.410760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022776-de6b-4738-b918-2559e995a533 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.411070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022776-de6b-4738-b918-2559e995a533 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.411355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8022776-de6b-4738-b918-2559e995a533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.428674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b8022776-de6b-4738-b918-2559e995a533 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:27:23.429861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b8022776-de6b-4738-b918-2559e995a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:23.487316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 748/1508] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:27:23.496919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:23.498308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:23.553822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c1c19-da1e-4c8d-b803-bcf8d95abba3 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:23.557320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f183957-682c-4781-87ec-0a8c7cf523a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:23.557965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183957-682c-4781-87ec-0a8c7cf523a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.558257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183957-682c-4781-87ec-0a8c7cf523a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.558531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183957-682c-4781-87ec-0a8c7cf523a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.567521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f183957-682c-4781-87ec-0a8c7cf523a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:23.568975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f183957-682c-4781-87ec-0a8c7cf523a0 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:23.578932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 761/1509] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:27:23.923526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8022776-de6b-4738-b918-2559e995a533 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:27:23.925779 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b8022776-de6b-4738-b918-2559e995a533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:27:23.948911 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8022776-de6b-4738-b918-2559e995a533 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:27:23.956482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:27:23.957888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:27:23.958247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:27:23.959165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] PATH_INFO: `/v3/projects/3f8cdb74f3f14bd6b52bac2d00ce625a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:27:23.960582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8cdb74f3f14bd6b52bac2d00ce625a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:27:23.962219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WARNING py.warnings [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:27:23.962219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: warnings.warn(msg) May 12 14:27:23.962219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: May 12 14:27:23.964195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:27:24.029333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8cdb74f3f14bd6b52bac2d00ce625a', 'request_id': 'req-350f788b-ca2a-482e-8ed9-c7fae7d45add'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:27:24.042814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8cdb74f3f14bd6b52bac2d00ce625a', 'request_id': 'req-350f788b-ca2a-482e-8ed9-c7fae7d45add'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:27:24.048642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8cdb74f3f14bd6b52bac2d00ce625a', 'request_id': 'req-350f788b-ca2a-482e-8ed9-c7fae7d45add'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:27:24.063688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] The token cache is being invalidate because project 3f8cdb74f3f14bd6b52bac2d00ce625a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:27:24.063904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:27:24.064610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-350f788b-ca2a-482e-8ed9-c7fae7d45add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:27:24.066154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 749/1510] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:27:23 2022] DELETE /identity/v3/projects/3f8cdb74f3f14bd6b52bac2d00ce625a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:29:09.276404 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dc7db-e092-4539-8875-551f04fc52b4 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:09.276926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dc7db-e092-4539-8875-551f04fc52b4 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:09.277033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174dc7db-e092-4539-8875-551f04fc52b4 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:09.278368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:09.283368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dacc9-d615-4217-8ffe-5172136c75c0 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:09.283928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dacc9-d615-4217-8ffe-5172136c75c0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:09.283928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dacc9-d615-4217-8ffe-5172136c75c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:09.302324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c97dacc9-d615-4217-8ffe-5172136c75c0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:09.303587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c97dacc9-d615-4217-8ffe-5172136c75c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:09.360300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:09.531134 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dc7db-e092-4539-8875-551f04fc52b4 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:09.532930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-174dc7db-e092-4539-8875-551f04fc52b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:09.607164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174dc7db-e092-4539-8875-551f04fc52b4 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:09.612540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fcb23-a9c6-4791-b262-567f607e67fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:09.613217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fcb23-a9c6-4791-b262-567f607e67fb service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:09.613506 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fcb23-a9c6-4791-b262-567f607e67fb service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:09.613788 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fcb23-a9c6-4791-b262-567f607e67fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:09.622897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fcb23-a9c6-4791-b262-567f607e67fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:09.624659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fcb23-a9c6-4791-b262-567f607e67fb service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:09.634502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 763/1513] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:29:10.543270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e5ae-bfec-4558-a62d-e5835a83667c None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:10.543856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e5ae-bfec-4558-a62d-e5835a83667c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:10.543856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6e5ae-bfec-4558-a62d-e5835a83667c None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:10.545199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:10.550085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cadab5-bbd4-4bbf-8687-3844adacd076 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:10.550500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cadab5-bbd4-4bbf-8687-3844adacd076 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:10.550646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cadab5-bbd4-4bbf-8687-3844adacd076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:10.568331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-14cadab5-bbd4-4bbf-8687-3844adacd076 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:10.569547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-14cadab5-bbd4-4bbf-8687-3844adacd076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:10.577448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:10.732674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6e5ae-bfec-4558-a62d-e5835a83667c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:10.746508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6e5ae-bfec-4558-a62d-e5835a83667c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:10.751814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ced56d-f693-4923-9c50-0caa3450f329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:10.752444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ced56d-f693-4923-9c50-0caa3450f329 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:10.752725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ced56d-f693-4923-9c50-0caa3450f329 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:10.752998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ced56d-f693-4923-9c50-0caa3450f329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:10.761273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ced56d-f693-4923-9c50-0caa3450f329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:10.762854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ced56d-f693-4923-9c50-0caa3450f329 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:10.772094 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 752/1516] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:11.734995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ce6f3-1980-4c78-aedf-bb3df508b6f0 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:11.735596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ce6f3-1980-4c78-aedf-bb3df508b6f0 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:11.735596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ce6f3-1980-4c78-aedf-bb3df508b6f0 None None] PATH_INFO: `/v3` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:11.737084 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 765/1517] 10.222.0.57 () {54 vars in 925 bytes} [Thu May 12 14:29:11 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:29:11.746099 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fa551-cdc1-4d74-b383-f210d15bebaf None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:11.746547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fa551-cdc1-4d74-b383-f210d15bebaf None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:11.746746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fa551-cdc1-4d74-b383-f210d15bebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:11.765190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-971fa551-cdc1-4d74-b383-f210d15bebaf None None] MFA Rules not processed for user `3004f3e4a9854502be59119e17e04961`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:11.766388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-971fa551-cdc1-4d74-b383-f210d15bebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:11.826794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 753/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Thu May 12 14:29:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:29:21.650013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ea64-79bb-419a-a82e-51c6b7bf0807 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:21.650607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ea64-79bb-419a-a82e-51c6b7bf0807 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:21.650607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ea64-79bb-419a-a82e-51c6b7bf0807 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:21.655242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 766/1519] 10.222.0.75 () {54 vars in 960 bytes} [Thu May 12 14:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:21.657506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e027-2fc6-4c1d-bc01-fc70c0ef4e93 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:21.657982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e027-2fc6-4c1d-bc01-fc70c0ef4e93 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:21.658083 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e027-2fc6-4c1d-bc01-fc70c0ef4e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:21.678437 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-0ac6e027-2fc6-4c1d-bc01-fc70c0ef4e93 None None] MFA Rules not processed for user `3004f3e4a9854502be59119e17e04961`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:21.680407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0ac6e027-2fc6-4c1d-bc01-fc70c0ef4e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:21.689505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 754/1520] 10.222.0.75 () {58 vars in 1057 bytes} [Thu May 12 14:29:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:21.697214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6ea64-79bb-419a-a82e-51c6b7bf0807 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:21.715940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6ea64-79bb-419a-a82e-51c6b7bf0807 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:21.720946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc74b13-ee09-401c-beef-987dfc3aa826 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3004f3e4a9854502be59119e17e04961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:21.721612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74b13-ee09-401c-beef-987dfc3aa826 service placement] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:21.721899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74b13-ee09-401c-beef-987dfc3aa826 service placement] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:21.722180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc74b13-ee09-401c-beef-987dfc3aa826 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:21.736129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc74b13-ee09-401c-beef-987dfc3aa826 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:21.737765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc74b13-ee09-401c-beef-987dfc3aa826 service placement] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:21.753330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 767/1521] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:29:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:22.211634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0c4f-d933-4538-900a-11dc1e36467f None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:22.211918 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0c4f-d933-4538-900a-11dc1e36467f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:22.212225 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde0c4f-d933-4538-900a-11dc1e36467f None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:22.213680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:22.219054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5808e-0925-45b0-b7df-0d586bb3a146 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:22.219349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5808e-0925-45b0-b7df-0d586bb3a146 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:22.219722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5808e-0925-45b0-b7df-0d586bb3a146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:22.237829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c1a5808e-0925-45b0-b7df-0d586bb3a146 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:22.239053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c1a5808e-0925-45b0-b7df-0d586bb3a146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:22.247797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:22.412416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde0c4f-d933-4538-900a-11dc1e36467f None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:22.428366 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde0c4f-d933-4538-900a-11dc1e36467f None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:22.434191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb5db2-e2e0-457f-90e7-392ec023531c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:22.434840 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5db2-e2e0-457f-90e7-392ec023531c service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:22.435159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5db2-e2e0-457f-90e7-392ec023531c service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:22.435432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb5db2-e2e0-457f-90e7-392ec023531c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:22.444059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb5db2-e2e0-457f-90e7-392ec023531c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:22.447510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb5db2-e2e0-457f-90e7-392ec023531c service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:22.459069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 756/1524] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:23.357803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911788b6-a26e-43d2-a822-0f964f6ccf78 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:23.358337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911788b6-a26e-43d2-a822-0f964f6ccf78 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:23.358458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911788b6-a26e-43d2-a822-0f964f6ccf78 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:23.359798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 12 14:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:23.364701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d75b9-0562-45da-bafa-0645153a54a1 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:23.365133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d75b9-0562-45da-bafa-0645153a54a1 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:23.365271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d75b9-0562-45da-bafa-0645153a54a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:23.384207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c65d75b9-0562-45da-bafa-0645153a54a1 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:23.385683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c65d75b9-0562-45da-bafa-0645153a54a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:23.393530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 12 14:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:23.546576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911788b6-a26e-43d2-a822-0f964f6ccf78 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:23.561370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911788b6-a26e-43d2-a822-0f964f6ccf78 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:23.566668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114a997-6701-4076-98f8-29fba1bd148e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:23.567329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a997-6701-4076-98f8-29fba1bd148e service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:23.567613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a997-6701-4076-98f8-29fba1bd148e service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:23.567887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114a997-6701-4076-98f8-29fba1bd148e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:23.576432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114a997-6701-4076-98f8-29fba1bd148e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:23.578015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114a997-6701-4076-98f8-29fba1bd148e service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:23.587061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 770/1527] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:27.797884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c3a34-ae1a-4a81-99bf-99da8b850943 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:27.798509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c3a34-ae1a-4a81-99bf-99da8b850943 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:27.798509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c3a34-ae1a-4a81-99bf-99da8b850943 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:27.799854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:27.805562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ad460-c98b-49c7-a05a-ead6feecf7ff None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:27.806025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ad460-c98b-49c7-a05a-ead6feecf7ff None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:27.806132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ad460-c98b-49c7-a05a-ead6feecf7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:27.824191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-db4ad460-c98b-49c7-a05a-ead6feecf7ff None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:27.825379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-db4ad460-c98b-49c7-a05a-ead6feecf7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:27.833014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:27.869162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c3a34-ae1a-4a81-99bf-99da8b850943 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:27.870917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6e1c3a34-ae1a-4a81-99bf-99da8b850943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:27.925781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c3a34-ae1a-4a81-99bf-99da8b850943 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:27.929854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f315d5b-d9c6-46c9-8b65-c1a44f29b193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:27.930524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f315d5b-d9c6-46c9-8b65-c1a44f29b193 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:27.930805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f315d5b-d9c6-46c9-8b65-c1a44f29b193 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:27.931107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f315d5b-d9c6-46c9-8b65-c1a44f29b193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:27.940034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f315d5b-d9c6-46c9-8b65-c1a44f29b193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:27.941485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f315d5b-d9c6-46c9-8b65-c1a44f29b193 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:27.951619 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 759/1530] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:30.183426 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132585d-7d3a-4989-9800-b2e67167b2c8 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:30.183997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132585d-7d3a-4989-9800-b2e67167b2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:30.183997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132585d-7d3a-4989-9800-b2e67167b2c8 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:30.185378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:30.190701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d612a7-8904-48cd-9fe3-3749233bfb1c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:30.191233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d612a7-8904-48cd-9fe3-3749233bfb1c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:30.191434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d612a7-8904-48cd-9fe3-3749233bfb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:30.209565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-41d612a7-8904-48cd-9fe3-3749233bfb1c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:30.210784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-41d612a7-8904-48cd-9fe3-3749233bfb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:30.218625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:30.260530 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132585d-7d3a-4989-9800-b2e67167b2c8 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:30.271493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132585d-7d3a-4989-9800-b2e67167b2c8 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:30.275013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf271e8a-c14d-43f4-a1c4-d5ea0a6d3832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:30.275671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf271e8a-c14d-43f4-a1c4-d5ea0a6d3832 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:30.275951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf271e8a-c14d-43f4-a1c4-d5ea0a6d3832 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:30.276223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf271e8a-c14d-43f4-a1c4-d5ea0a6d3832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:30.285773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf271e8a-c14d-43f4-a1c4-d5ea0a6d3832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:30.287350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf271e8a-c14d-43f4-a1c4-d5ea0a6d3832 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:30.297963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 773/1533] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:34.324896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634c5a-0425-4afd-bbb9-c063dae65327 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:34.325458 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634c5a-0425-4afd-bbb9-c063dae65327 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:34.325458 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634c5a-0425-4afd-bbb9-c063dae65327 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:34.326824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:34.332380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77681e87-704a-408e-8b88-f332cd68a3a6 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:34.332785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77681e87-704a-408e-8b88-f332cd68a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:34.332948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77681e87-704a-408e-8b88-f332cd68a3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:34.350958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-77681e87-704a-408e-8b88-f332cd68a3a6 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:34.352292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-77681e87-704a-408e-8b88-f332cd68a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:34.360022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:34.631716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10634c5a-0425-4afd-bbb9-c063dae65327 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:34.633971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-10634c5a-0425-4afd-bbb9-c063dae65327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:34.702665 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10634c5a-0425-4afd-bbb9-c063dae65327 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:34.706408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8084e-e2c6-47f7-9bfd-7caaa997854f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:34.707090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8084e-e2c6-47f7-9bfd-7caaa997854f service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:34.707380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8084e-e2c6-47f7-9bfd-7caaa997854f service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:34.707658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8084e-e2c6-47f7-9bfd-7caaa997854f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:34.717000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8084e-e2c6-47f7-9bfd-7caaa997854f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:34.718446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8084e-e2c6-47f7-9bfd-7caaa997854f service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:34.730255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 762/1536] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:29:37.002243 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b8cb9-c0a9-4cea-9e55-8591c5a3ae98 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:37.002834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b8cb9-c0a9-4cea-9e55-8591c5a3ae98 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:37.002834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b8cb9-c0a9-4cea-9e55-8591c5a3ae98 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:37.004283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 12 14:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:29:37.009792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef02514-e73b-4cd2-b390-edc377476391 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:37.010196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef02514-e73b-4cd2-b390-edc377476391 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:37.010362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef02514-e73b-4cd2-b390-edc377476391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:37.028840 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-aef02514-e73b-4cd2-b390-edc377476391 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:29:37.030044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-aef02514-e73b-4cd2-b390-edc377476391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:37.037832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 12 14:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:29:37.310408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b8cb9-c0a9-4cea-9e55-8591c5a3ae98 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:29:37.312081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2c4b8cb9-c0a9-4cea-9e55-8591c5a3ae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:29:37.325282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b8cb9-c0a9-4cea-9e55-8591c5a3ae98 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:29:37.328785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cb630-b5fb-444d-ab9d-49ff9782e224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:29:37.329416 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cb630-b5fb-444d-ab9d-49ff9782e224 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:29:37.329700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cb630-b5fb-444d-ab9d-49ff9782e224 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:29:37.329981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cb630-b5fb-444d-ab9d-49ff9782e224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:29:37.339253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cb630-b5fb-444d-ab9d-49ff9782e224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:29:37.340696 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cb630-b5fb-444d-ab9d-49ff9782e224 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:29:37.350172 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 776/1539] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:12.258122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2758c-936a-4902-a823-d83f3194aa79 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.258718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2758c-936a-4902-a823-d83f3194aa79 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.258718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2758c-936a-4902-a823-d83f3194aa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.284538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4054-1e1f-4a89-901f-9e647a91fe41 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.285124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4054-1e1f-4a89-901f-9e647a91fe41 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.285124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4054-1e1f-4a89-901f-9e647a91fe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.292988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-34e2758c-936a-4902-a823-d83f3194aa79 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.294970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-34e2758c-936a-4902-a823-d83f3194aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.312097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-7d9c4054-1e1f-4a89-901f-9e647a91fe41 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.313429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 764/1540] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.313557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7d9c4054-1e1f-4a89-901f-9e647a91fe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.330546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04dbe9-e7ca-46d1-b415-9a88dd346ef4 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.330546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04dbe9-e7ca-46d1-b415-9a88dd346ef4 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.330546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04dbe9-e7ca-46d1-b415-9a88dd346ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.330916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 777/1541] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:31:12.344625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92874-00b1-44ff-a4c8-9e56d48de8c4 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.344972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92874-00b1-44ff-a4c8-9e56d48de8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.345192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92874-00b1-44ff-a4c8-9e56d48de8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.366476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-ea04dbe9-e7ca-46d1-b415-9a88dd346ef4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.368316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ea04dbe9-e7ca-46d1-b415-9a88dd346ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.374520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-5cd92874-00b1-44ff-a4c8-9e56d48de8c4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.376332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5cd92874-00b1-44ff-a4c8-9e56d48de8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.394817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 778/1542] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.397659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 765/1543] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.398249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8719c-b5d2-49f5-99bc-11bda3074254 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.398544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8719c-b5d2-49f5-99bc-11bda3074254 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.398826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8719c-b5d2-49f5-99bc-11bda3074254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.400171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2790d-7f51-40d5-bb6a-36e22ebb2e64 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.400725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2790d-7f51-40d5-bb6a-36e22ebb2e64 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.401265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2790d-7f51-40d5-bb6a-36e22ebb2e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.420841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-d6d2790d-7f51-40d5-bb6a-36e22ebb2e64 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.422478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d6d2790d-7f51-40d5-bb6a-36e22ebb2e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.431917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 766/1544] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.433740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbffb9-f572-434c-9bfa-b2e922d05f50 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.434381 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbffb9-f572-434c-9bfa-b2e922d05f50 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.434891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbffb9-f572-434c-9bfa-b2e922d05f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.445769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-5ca8719c-b5d2-49f5-99bc-11bda3074254 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.447071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5ca8719c-b5d2-49f5-99bc-11bda3074254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.457994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2cfbffb9-f572-434c-9bfa-b2e922d05f50 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.460834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2cfbffb9-f572-434c-9bfa-b2e922d05f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.470238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 767/1545] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.471657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbffb9-f572-434c-9bfa-b2e922d05f50 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.481425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 779/1546] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.487281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8719c-b5d2-49f5-99bc-11bda3074254 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.488339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbffb9-f572-434c-9bfa-b2e922d05f50 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.496770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac2120-1cb8-4a7c-940b-a2c220df4697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.503671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2120-1cb8-4a7c-940b-a2c220df4697 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.504313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2120-1cb8-4a7c-940b-a2c220df4697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.504850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac2120-1cb8-4a7c-940b-a2c220df4697 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.505967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8719c-b5d2-49f5-99bc-11bda3074254 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.506935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2120-1cb8-4a7c-940b-a2c220df4697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:12.507742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2120-1cb8-4a7c-940b-a2c220df4697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.510380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac2120-1cb8-4a7c-940b-a2c220df4697 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.517291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad8aa1-b4c1-4cd9-9e82-0f871521c537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.518275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad8aa1-b4c1-4cd9-9e82-0f871521c537 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.523455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad8aa1-b4c1-4cd9-9e82-0f871521c537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.524001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad8aa1-b4c1-4cd9-9e82-0f871521c537 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.524967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad8aa1-b4c1-4cd9-9e82-0f871521c537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:12.525514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad8aa1-b4c1-4cd9-9e82-0f871521c537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.526761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: WARNING py.warnings [None req-57ad8aa1-b4c1-4cd9-9e82-0f871521c537 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:31:12.526761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: warnings.warn(msg) May 12 14:31:12.526761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: May 12 14:31:12.528088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad8aa1-b4c1-4cd9-9e82-0f871521c537 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.539982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 768/1547] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:12.541771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f732c-57d1-451b-b417-e58b6c95d25f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.542314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f732c-57d1-451b-b417-e58b6c95d25f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.543828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f732c-57d1-451b-b417-e58b6c95d25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.551924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 780/1548] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:12.555085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c030a54-8fbc-4f25-b3b2-69592c567685 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.556032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c030a54-8fbc-4f25-b3b2-69592c567685 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.557980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c030a54-8fbc-4f25-b3b2-69592c567685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.572475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-923f732c-57d1-451b-b417-e58b6c95d25f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.574186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-923f732c-57d1-451b-b417-e58b6c95d25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.578201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-1c030a54-8fbc-4f25-b3b2-69592c567685 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.579514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1c030a54-8fbc-4f25-b3b2-69592c567685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.582518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 769/1549] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.584459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbdf7b-d833-4e93-9456-3798b7379ec9 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.584747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbdf7b-d833-4e93-9456-3798b7379ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.585022 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbdf7b-d833-4e93-9456-3798b7379ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.591986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 781/1550] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.592743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c030a54-8fbc-4f25-b3b2-69592c567685 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.602618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c030a54-8fbc-4f25-b3b2-69592c567685 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.604096 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-dcdbdf7b-d833-4e93-9456-3798b7379ec9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.605246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-dcdbdf7b-d833-4e93-9456-3798b7379ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.607539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d15d2-4624-4cff-8fae-6db0d82370df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.608413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d15d2-4624-4cff-8fae-6db0d82370df admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.608788 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d15d2-4624-4cff-8fae-6db0d82370df admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.612478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d15d2-4624-4cff-8fae-6db0d82370df admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.612478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d15d2-4624-4cff-8fae-6db0d82370df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.612478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d15d2-4624-4cff-8fae-6db0d82370df admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.627129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 770/1551] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.627129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbdf7b-d833-4e93-9456-3798b7379ec9 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.635653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbdf7b-d833-4e93-9456-3798b7379ec9 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.641020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc060ef-533d-4ffc-b40e-b4a42521fd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.641757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc060ef-533d-4ffc-b40e-b4a42521fd63 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.642021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc060ef-533d-4ffc-b40e-b4a42521fd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.642246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc060ef-533d-4ffc-b40e-b4a42521fd63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.642942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc060ef-533d-4ffc-b40e-b4a42521fd63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.643982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WARNING py.warnings [None req-5cc060ef-533d-4ffc-b40e-b4a42521fd63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:31:12.643982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: warnings.warn(msg) May 12 14:31:12.643982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: May 12 14:31:12.645402 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc060ef-533d-4ffc-b40e-b4a42521fd63 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.646857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 782/1552] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:12.652097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74441461-2dc2-4090-bc9b-2bafbfc5f452 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.652395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74441461-2dc2-4090-bc9b-2bafbfc5f452 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.653268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74441461-2dc2-4090-bc9b-2bafbfc5f452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.672598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-74441461-2dc2-4090-bc9b-2bafbfc5f452 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.673845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-74441461-2dc2-4090-bc9b-2bafbfc5f452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.683160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 771/1553] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:12.683160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a4fe-1003-4e11-abfa-9102407ceb1b None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.683160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a4fe-1003-4e11-abfa-9102407ceb1b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.683160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a4fe-1003-4e11-abfa-9102407ceb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.700153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-47e3a4fe-1003-4e11-abfa-9102407ceb1b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.701347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-47e3a4fe-1003-4e11-abfa-9102407ceb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.751907 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 783/1554] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.753209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74441461-2dc2-4090-bc9b-2bafbfc5f452 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.766997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74441461-2dc2-4090-bc9b-2bafbfc5f452 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.772272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 772/1555] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.772403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143453ba-ffed-4494-9954-6ce17504db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.773154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143453ba-ffed-4494-9954-6ce17504db54 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.773537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143453ba-ffed-4494-9954-6ce17504db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.773877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143453ba-ffed-4494-9954-6ce17504db54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.774747 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143453ba-ffed-4494-9954-6ce17504db54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:12.775184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143453ba-ffed-4494-9954-6ce17504db54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.776580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a4fe-1003-4e11-abfa-9102407ceb1b None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.777987 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143453ba-ffed-4494-9954-6ce17504db54 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.791984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a4fe-1003-4e11-abfa-9102407ceb1b None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.802873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 784/1556] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:12.802873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4386548-e283-4c4d-801a-931b56156ff0 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.802873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4386548-e283-4c4d-801a-931b56156ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.802873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4386548-e283-4c4d-801a-931b56156ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.805071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b478a3-204b-4ed2-98c3-8246a41d5695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.805750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b478a3-204b-4ed2-98c3-8246a41d5695 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.806036 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b478a3-204b-4ed2-98c3-8246a41d5695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.806312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b478a3-204b-4ed2-98c3-8246a41d5695 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.807081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b478a3-204b-4ed2-98c3-8246a41d5695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:12.807394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b478a3-204b-4ed2-98c3-8246a41d5695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.808999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b478a3-204b-4ed2-98c3-8246a41d5695 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.816647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a4386548-e283-4c4d-801a-931b56156ff0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.818479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a4386548-e283-4c4d-801a-931b56156ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.821104 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 773/1557] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:12.821903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b478a3-204b-4ed2-98c3-8246a41d5695 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.827103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 785/1558] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.831945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4386548-e283-4c4d-801a-931b56156ff0 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.832097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b478a3-204b-4ed2-98c3-8246a41d5695 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.836770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cad7b-b1b8-481d-bfdb-28ba7fccb629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.837437 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cad7b-b1b8-481d-bfdb-28ba7fccb629 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.837726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cad7b-b1b8-481d-bfdb-28ba7fccb629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.838002 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cad7b-b1b8-481d-bfdb-28ba7fccb629 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.838732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cad7b-b1b8-481d-bfdb-28ba7fccb629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:12.839059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cad7b-b1b8-481d-bfdb-28ba7fccb629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.840694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342cad7b-b1b8-481d-bfdb-28ba7fccb629 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.841452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4386548-e283-4c4d-801a-931b56156ff0 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.846187 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50621b51-295a-47d1-b94d-9dd75c6fe9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.846849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50621b51-295a-47d1-b94d-9dd75c6fe9ac admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.847156 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50621b51-295a-47d1-b94d-9dd75c6fe9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.847432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50621b51-295a-47d1-b94d-9dd75c6fe9ac admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.848117 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50621b51-295a-47d1-b94d-9dd75c6fe9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.849130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: WARNING py.warnings [None req-50621b51-295a-47d1-b94d-9dd75c6fe9ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:31:12.849130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: warnings.warn(msg) May 12 14:31:12.849130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: May 12 14:31:12.850558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50621b51-295a-47d1-b94d-9dd75c6fe9ac admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.853146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 774/1559] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:12.853919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cad7b-b1b8-481d-bfdb-28ba7fccb629 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.865904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cad7b-b1b8-481d-bfdb-28ba7fccb629 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.870547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577191e9-45e9-48c5-b49e-d92cf07ecb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.871242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577191e9-45e9-48c5-b49e-d92cf07ecb95 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.871525 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577191e9-45e9-48c5-b49e-d92cf07ecb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.871625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 786/1560] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:12.871808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577191e9-45e9-48c5-b49e-d92cf07ecb95 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.872491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577191e9-45e9-48c5-b49e-d92cf07ecb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.873102 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754588c1-b5b1-48c7-bebc-1b86b519cfa0 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.873539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754588c1-b5b1-48c7-bebc-1b86b519cfa0 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.873943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754588c1-b5b1-48c7-bebc-1b86b519cfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.874610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577191e9-45e9-48c5-b49e-d92cf07ecb95 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.893612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-754588c1-b5b1-48c7-bebc-1b86b519cfa0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.894196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 775/1561] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:12.894906 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-754588c1-b5b1-48c7-bebc-1b86b519cfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.898892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a097c-47f9-4b29-bbbf-a1c5123cc7c0 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.899214 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a097c-47f9-4b29-bbbf-a1c5123cc7c0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.899501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a097c-47f9-4b29-bbbf-a1c5123cc7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.902760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 787/1562] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.903644 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754588c1-b5b1-48c7-bebc-1b86b519cfa0 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.913036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754588c1-b5b1-48c7-bebc-1b86b519cfa0 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.917507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-617a097c-47f9-4b29-bbbf-a1c5123cc7c0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.917856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f8f1-25cb-4f08-aa29-85c60f37d5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.918601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f8f1-25cb-4f08-aa29-85c60f37d5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.918813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-617a097c-47f9-4b29-bbbf-a1c5123cc7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.918932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f8f1-25cb-4f08-aa29-85c60f37d5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.919265 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f8f1-25cb-4f08-aa29-85c60f37d5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.920019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f8f1-25cb-4f08-aa29-85c60f37d5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.922030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f8f1-25cb-4f08-aa29-85c60f37d5d3 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.926958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 776/1563] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:12.933059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a097c-47f9-4b29-bbbf-a1c5123cc7c0 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:12.946067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a097c-47f9-4b29-bbbf-a1c5123cc7c0 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:12.951870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896004e3-1c7f-481e-83ce-a2993cf98833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:12.952628 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896004e3-1c7f-481e-83ce-a2993cf98833 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.952822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896004e3-1c7f-481e-83ce-a2993cf98833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.953346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 788/1564] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:12.953474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896004e3-1c7f-481e-83ce-a2993cf98833 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.954038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896004e3-1c7f-481e-83ce-a2993cf98833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:12.956055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896004e3-1c7f-481e-83ce-a2993cf98833 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:12.957101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d695cd4-490a-42b4-b0d6-47bfbc39518b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:12.957396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d695cd4-490a-42b4-b0d6-47bfbc39518b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:12.957678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d695cd4-490a-42b4-b0d6-47bfbc39518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:12.976095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-5d695cd4-490a-42b4-b0d6-47bfbc39518b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:12.977300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5d695cd4-490a-42b4-b0d6-47bfbc39518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:12.981452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 777/1565] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:12.982086 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896004e3-1c7f-481e-83ce-a2993cf98833 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.043158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 789/1566] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:13.043942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d695cd4-490a-42b4-b0d6-47bfbc39518b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.050608 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896004e3-1c7f-481e-83ce-a2993cf98833 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.054858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d695cd4-490a-42b4-b0d6-47bfbc39518b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.056084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c592f-5e7a-4659-964b-598140015d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.056783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c592f-5e7a-4659-964b-598140015d06 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.057114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c592f-5e7a-4659-964b-598140015d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.057399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c592f-5e7a-4659-964b-598140015d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.058100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c592f-5e7a-4659-964b-598140015d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.059719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212af11-af80-4db2-aa26-78c27ef6d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.060056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c592f-5e7a-4659-964b-598140015d06 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.060380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212af11-af80-4db2-aa26-78c27ef6d20d admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.060663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212af11-af80-4db2-aa26-78c27ef6d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.060942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212af11-af80-4db2-aa26-78c27ef6d20d admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.061698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212af11-af80-4db2-aa26-78c27ef6d20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.063316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212af11-af80-4db2-aa26-78c27ef6d20d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.074487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 790/1567] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.075235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212af11-af80-4db2-aa26-78c27ef6d20d admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.085723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212af11-af80-4db2-aa26-78c27ef6d20d admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.090478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fb63-b653-4e8c-836c-2dcf39c4ea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.091168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fb63-b653-4e8c-836c-2dcf39c4ea70 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.091456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 778/1568] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:12 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:13.092452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c592f-5e7a-4659-964b-598140015d06 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.094787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fb63-b653-4e8c-836c-2dcf39c4ea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.095119 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fb63-b653-4e8c-836c-2dcf39c4ea70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.095881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2fb63-b653-4e8c-836c-2dcf39c4ea70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.097541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2fb63-b653-4e8c-836c-2dcf39c4ea70 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.108125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 791/1569] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.109048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fb63-b653-4e8c-836c-2dcf39c4ea70 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.118608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fb63-b653-4e8c-836c-2dcf39c4ea70 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.157887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c592f-5e7a-4659-964b-598140015d06 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.164064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070297d-61b7-4ab5-b91c-963447c8fe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.164861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070297d-61b7-4ab5-b91c-963447c8fe9c admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.165150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070297d-61b7-4ab5-b91c-963447c8fe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.165422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070297d-61b7-4ab5-b91c-963447c8fe9c admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.166157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070297d-61b7-4ab5-b91c-963447c8fe9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:13.166469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070297d-61b7-4ab5-b91c-963447c8fe9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.168129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070297d-61b7-4ab5-b91c-963447c8fe9c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.173245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9f56b-5db0-4ee5-a6cb-133035de341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.174065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9f56b-5db0-4ee5-a6cb-133035de341a admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.174352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9f56b-5db0-4ee5-a6cb-133035de341a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.174626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9f56b-5db0-4ee5-a6cb-133035de341a admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.175384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9f56b-5db0-4ee5-a6cb-133035de341a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:13.175720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9f56b-5db0-4ee5-a6cb-133035de341a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.177369 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9f56b-5db0-4ee5-a6cb-133035de341a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.179746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 779/1570] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:13.180546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070297d-61b7-4ab5-b91c-963447c8fe9c admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.189860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070297d-61b7-4ab5-b91c-963447c8fe9c admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.195085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638c3d-f0e4-498d-93a2-8d7b830edf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.195752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638c3d-f0e4-498d-93a2-8d7b830edf9f admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.196038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638c3d-f0e4-498d-93a2-8d7b830edf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.196313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638c3d-f0e4-498d-93a2-8d7b830edf9f admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.196897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 792/1571] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:13.197043 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b638c3d-f0e4-498d-93a2-8d7b830edf9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.197809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9f56b-5db0-4ee5-a6cb-133035de341a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.198985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b638c3d-f0e4-498d-93a2-8d7b830edf9f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.207816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9f56b-5db0-4ee5-a6cb-133035de341a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.213678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127840c-d142-4e22-9fd6-f7d0cbc15f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.214301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127840c-d142-4e22-9fd6-f7d0cbc15f93 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.214580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127840c-d142-4e22-9fd6-f7d0cbc15f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.214872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127840c-d142-4e22-9fd6-f7d0cbc15f93 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.215599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127840c-d142-4e22-9fd6-f7d0cbc15f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.217547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127840c-d142-4e22-9fd6-f7d0cbc15f93 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.222599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 780/1572] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:13.222599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638c3d-f0e4-498d-93a2-8d7b830edf9f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.230390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638c3d-f0e4-498d-93a2-8d7b830edf9f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.235348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a334bef-24ff-40f0-b573-d90df1c39bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.236009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334bef-24ff-40f0-b573-d90df1c39bba admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.236295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334bef-24ff-40f0-b573-d90df1c39bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.236575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334bef-24ff-40f0-b573-d90df1c39bba admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.237302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a334bef-24ff-40f0-b573-d90df1c39bba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:13.237613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a334bef-24ff-40f0-b573-d90df1c39bba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.240921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 793/1573] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:13.240921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127840c-d142-4e22-9fd6-f7d0cbc15f93 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.241153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a334bef-24ff-40f0-b573-d90df1c39bba admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.249521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127840c-d142-4e22-9fd6-f7d0cbc15f93 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.251768 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 781/1574] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:13.252641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a334bef-24ff-40f0-b573-d90df1c39bba admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.259264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ec494-2e17-4701-bf9a-4f252bfe1b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.260343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ec494-2e17-4701-bf9a-4f252bfe1b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.260708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ec494-2e17-4701-bf9a-4f252bfe1b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.261086 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ec494-2e17-4701-bf9a-4f252bfe1b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.261831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ec494-2e17-4701-bf9a-4f252bfe1b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.262935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a334bef-24ff-40f0-b573-d90df1c39bba admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.263511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ec494-2e17-4701-bf9a-4f252bfe1b5f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.267553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e6b5-4178-4d1d-b316-266e4e33c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.268212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e6b5-4178-4d1d-b316-266e4e33c4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.268496 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e6b5-4178-4d1d-b316-266e4e33c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.268781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e6b5-4178-4d1d-b316-266e4e33c4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.269468 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e6b5-4178-4d1d-b316-266e4e33c4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.272001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e6b5-4178-4d1d-b316-266e4e33c4e0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.277310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 794/1575] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.277310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ec494-2e17-4701-bf9a-4f252bfe1b5f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.284377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ec494-2e17-4701-bf9a-4f252bfe1b5f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.289271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1e7d7-e844-4183-b8b5-b35b6757e066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.289933 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1e7d7-e844-4183-b8b5-b35b6757e066 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.290216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1e7d7-e844-4183-b8b5-b35b6757e066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.290496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1e7d7-e844-4183-b8b5-b35b6757e066 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.291250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1e7d7-e844-4183-b8b5-b35b6757e066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.294943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 782/1576] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:13.295188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1e7d7-e844-4183-b8b5-b35b6757e066 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.295303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e6b5-4178-4d1d-b316-266e4e33c4e0 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.303458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 795/1577] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.304316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e6b5-4178-4d1d-b316-266e4e33c4e0 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.306725 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1e7d7-e844-4183-b8b5-b35b6757e066 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.309026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ac1f0-2756-4f9c-b5d0-afb684b7a53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.309681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ac1f0-2756-4f9c-b5d0-afb684b7a53a admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.309967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ac1f0-2756-4f9c-b5d0-afb684b7a53a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.310244 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ac1f0-2756-4f9c-b5d0-afb684b7a53a admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.310957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ac1f0-2756-4f9c-b5d0-afb684b7a53a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.312887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ac1f0-2756-4f9c-b5d0-afb684b7a53a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.316511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1e7d7-e844-4183-b8b5-b35b6757e066 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.321880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33d839-c589-449c-bd9d-ee0dbcd786da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.322528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33d839-c589-449c-bd9d-ee0dbcd786da admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.322836 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33d839-c589-449c-bd9d-ee0dbcd786da admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.323148 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33d839-c589-449c-bd9d-ee0dbcd786da admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.323832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33d839-c589-449c-bd9d-ee0dbcd786da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.325733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33d839-c589-449c-bd9d-ee0dbcd786da admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.339994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 783/1578] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:13.341202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ac1f0-2756-4f9c-b5d0-afb684b7a53a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.352025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 796/1579] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:13.352856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33d839-c589-449c-bd9d-ee0dbcd786da admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.406542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ac1f0-2756-4f9c-b5d0-afb684b7a53a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.411155 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86ea7f-329f-47f5-88a3-4551f7f6ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.411993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ea7f-329f-47f5-88a3-4551f7f6ccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.412353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ea7f-329f-47f5-88a3-4551f7f6ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.412630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86ea7f-329f-47f5-88a3-4551f7f6ccb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.413354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86ea7f-329f-47f5-88a3-4551f7f6ccb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.414261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33d839-c589-449c-bd9d-ee0dbcd786da admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.414955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86ea7f-329f-47f5-88a3-4551f7f6ccb7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.418935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179d781-3edc-42d7-b781-f0467a62ac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.419629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179d781-3edc-42d7-b781-f0467a62ac43 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.419919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179d781-3edc-42d7-b781-f0467a62ac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.420214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179d781-3edc-42d7-b781-f0467a62ac43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.420930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179d781-3edc-42d7-b781-f0467a62ac43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.422584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179d781-3edc-42d7-b781-f0467a62ac43 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.425113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 784/1580] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.425799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86ea7f-329f-47f5-88a3-4551f7f6ccb7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.435262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 797/1581] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.435262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179d781-3edc-42d7-b781-f0467a62ac43 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.436092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86ea7f-329f-47f5-88a3-4551f7f6ccb7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.440750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd49c6d-7b80-4705-96f3-911a91e1b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.441406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd49c6d-7b80-4705-96f3-911a91e1b765 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.441675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd49c6d-7b80-4705-96f3-911a91e1b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.441950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd49c6d-7b80-4705-96f3-911a91e1b765 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.442630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd49c6d-7b80-4705-96f3-911a91e1b765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.443942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179d781-3edc-42d7-b781-f0467a62ac43 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.445352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd49c6d-7b80-4705-96f3-911a91e1b765 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.448694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea847-8419-4709-a311-c59f6d79199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.449656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea847-8419-4709-a311-c59f6d79199d admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.449942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea847-8419-4709-a311-c59f6d79199d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.450219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea847-8419-4709-a311-c59f6d79199d admin admin] PATH_INFO: `/v3/projects/3be0839a5f6b49f5be6ae6adea94883b/users/dfb54adc3da14a21a903d9025ad60881/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.466630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ea847-8419-4709-a311-c59f6d79199d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3be0839a5f6b49f5be6ae6adea94883b, user_id=dfb54adc3da14a21a903d9025ad60881, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.469495 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ea847-8419-4709-a311-c59f6d79199d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.477170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 785/1582] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:13.478415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd49c6d-7b80-4705-96f3-911a91e1b765 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.484001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 798/1583] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:13 2022] PUT /identity/v3/projects/3be0839a5f6b49f5be6ae6adea94883b/users/dfb54adc3da14a21a903d9025ad60881/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:13.485047 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea847-8419-4709-a311-c59f6d79199d admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.543185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea847-8419-4709-a311-c59f6d79199d admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.547517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd49c6d-7b80-4705-96f3-911a91e1b765 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.548176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd4eb-1222-4a53-b47d-8234cbf4014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.549093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd4eb-1222-4a53-b47d-8234cbf4014f admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.549370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd4eb-1222-4a53-b47d-8234cbf4014f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.549640 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd4eb-1222-4a53-b47d-8234cbf4014f admin admin] PATH_INFO: `/v3/projects/202791457f0749649e8cc096f6e43404/users/c3b76edcb338405a9bf2f68e91dfacdd/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.552006 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4bf64-c4b8-40de-beaf-94ba8315862a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.553325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4bf64-c4b8-40de-beaf-94ba8315862a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.553605 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4bf64-c4b8-40de-beaf-94ba8315862a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.553912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4bf64-c4b8-40de-beaf-94ba8315862a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.554614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4bf64-c4b8-40de-beaf-94ba8315862a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.556786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4bf64-c4b8-40de-beaf-94ba8315862a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.565186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bd4eb-1222-4a53-b47d-8234cbf4014f admin admin] RBAC: Authorizing `identity:create_grant(project_id=202791457f0749649e8cc096f6e43404, user_id=c3b76edcb338405a9bf2f68e91dfacdd, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.568459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bd4eb-1222-4a53-b47d-8234cbf4014f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.569186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 786/1584] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.569980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4bf64-c4b8-40de-beaf-94ba8315862a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.580906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4bf64-c4b8-40de-beaf-94ba8315862a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.581475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 799/1585] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:13 2022] PUT /identity/v3/projects/202791457f0749649e8cc096f6e43404/users/c3b76edcb338405a9bf2f68e91dfacdd/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:13.585480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd4eb-1222-4a53-b47d-8234cbf4014f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.641698 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a96e9-ea5d-43d5-a602-4f2cf4c75bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.642399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a96e9-ea5d-43d5-a602-4f2cf4c75bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.642684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a96e9-ea5d-43d5-a602-4f2cf4c75bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.642965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a96e9-ea5d-43d5-a602-4f2cf4c75bf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.643714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a96e9-ea5d-43d5-a602-4f2cf4c75bf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.645682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd4eb-1222-4a53-b47d-8234cbf4014f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.645899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a96e9-ea5d-43d5-a602-4f2cf4c75bf0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.650384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade36573-96e8-4dab-af38-13f55e0bd707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.651100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36573-96e8-4dab-af38-13f55e0bd707 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.651456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36573-96e8-4dab-af38-13f55e0bd707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.651643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade36573-96e8-4dab-af38-13f55e0bd707 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.652456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade36573-96e8-4dab-af38-13f55e0bd707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.655072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade36573-96e8-4dab-af38-13f55e0bd707 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.666592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 787/1586] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:13.667445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a96e9-ea5d-43d5-a602-4f2cf4c75bf0 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.677824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a96e9-ea5d-43d5-a602-4f2cf4c75bf0 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.683972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 800/1587] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:13.683972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade36573-96e8-4dab-af38-13f55e0bd707 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.684231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd297700-4557-4dec-973f-d9b072223d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.684231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd297700-4557-4dec-973f-d9b072223d34 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.684231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd297700-4557-4dec-973f-d9b072223d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.684231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd297700-4557-4dec-973f-d9b072223d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.684642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd297700-4557-4dec-973f-d9b072223d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.686260 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd297700-4557-4dec-973f-d9b072223d34 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.691856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade36573-96e8-4dab-af38-13f55e0bd707 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.697200 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1eaf2b-5648-4a6b-8742-77b0f25f5eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.697376 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 788/1588] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.697862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eaf2b-5648-4a6b-8742-77b0f25f5eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.698131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd297700-4557-4dec-973f-d9b072223d34 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.698245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eaf2b-5648-4a6b-8742-77b0f25f5eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.698408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1eaf2b-5648-4a6b-8742-77b0f25f5eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.699161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1eaf2b-5648-4a6b-8742-77b0f25f5eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.700773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1eaf2b-5648-4a6b-8742-77b0f25f5eb2 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.709712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd297700-4557-4dec-973f-d9b072223d34 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.712138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 801/1589] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.713451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c36bb-0ce7-4e02-9c94-752d93840aa7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.713745 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c36bb-0ce7-4e02-9c94-752d93840aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.714034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c36bb-0ce7-4e02-9c94-752d93840aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.714511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6921db-0c03-4351-9c4f-61a632ef16d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.715365 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6921db-0c03-4351-9c4f-61a632ef16d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.715663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6921db-0c03-4351-9c4f-61a632ef16d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.715936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6921db-0c03-4351-9c4f-61a632ef16d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.716626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6921db-0c03-4351-9c4f-61a632ef16d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.718552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6921db-0c03-4351-9c4f-61a632ef16d9 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.743112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f40c36bb-0ce7-4e02-9c94-752d93840aa7 None None] MFA Rules not processed for user `dfb54adc3da14a21a903d9025ad60881`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:13.743792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 789/1590] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:13.745432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6921db-0c03-4351-9c4f-61a632ef16d9 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.748101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f40c36bb-0ce7-4e02-9c94-752d93840aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:13.758547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6921db-0c03-4351-9c4f-61a632ef16d9 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.764448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad58e59-778a-46f8-8fa0-e6188f7397eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.765124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58e59-778a-46f8-8fa0-e6188f7397eb admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.765407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58e59-778a-46f8-8fa0-e6188f7397eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.765687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58e59-778a-46f8-8fa0-e6188f7397eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.767510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad58e59-778a-46f8-8fa0-e6188f7397eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.769642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad58e59-778a-46f8-8fa0-e6188f7397eb admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.780225 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 790/1591] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.781492 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225570c7-11fc-4925-8fd8-ae32e2bb3084 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.781789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225570c7-11fc-4925-8fd8-ae32e2bb3084 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.782092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225570c7-11fc-4925-8fd8-ae32e2bb3084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.801569 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-225570c7-11fc-4925-8fd8-ae32e2bb3084 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:13.804095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-225570c7-11fc-4925-8fd8-ae32e2bb3084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:13.812696 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 791/1592] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:13.813505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225570c7-11fc-4925-8fd8-ae32e2bb3084 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.826058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 802/1593] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:13.826058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c36bb-0ce7-4e02-9c94-752d93840aa7 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.826384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225570c7-11fc-4925-8fd8-ae32e2bb3084 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.829298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c76f7-6747-462a-9956-b598d215c78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.830251 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c76f7-6747-462a-9956-b598d215c78f admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.830251 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c76f7-6747-462a-9956-b598d215c78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.830531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c76f7-6747-462a-9956-b598d215c78f admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.831409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c76f7-6747-462a-9956-b598d215c78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.833023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c76f7-6747-462a-9956-b598d215c78f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.834666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c36bb-0ce7-4e02-9c94-752d93840aa7 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.839582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207823fe-fcaf-4edb-a7e3-e894169bf68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.840665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207823fe-fcaf-4edb-a7e3-e894169bf68f admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.840665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207823fe-fcaf-4edb-a7e3-e894169bf68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.840665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207823fe-fcaf-4edb-a7e3-e894169bf68f admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.841549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207823fe-fcaf-4edb-a7e3-e894169bf68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.843353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207823fe-fcaf-4edb-a7e3-e894169bf68f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.845311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 792/1594] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.846022 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c76f7-6747-462a-9956-b598d215c78f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.856198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c76f7-6747-462a-9956-b598d215c78f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.857306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 803/1595] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:13.858114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207823fe-fcaf-4edb-a7e3-e894169bf68f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.863426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627bff6-9a2b-4218-8038-59dbe1b24dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.864338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627bff6-9a2b-4218-8038-59dbe1b24dae admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.865202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627bff6-9a2b-4218-8038-59dbe1b24dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.865490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627bff6-9a2b-4218-8038-59dbe1b24dae admin admin] PATH_INFO: `/v3/projects/b7ed5932615343aa9d806ed2a38c603d/users/03d540e2706a4c3491629f6b8fc40ff9/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.870043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207823fe-fcaf-4edb-a7e3-e894169bf68f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.874561 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c9403-bf13-47d6-b401-6851baea0ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.875466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c9403-bf13-47d6-b401-6851baea0ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.875753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c9403-bf13-47d6-b401-6851baea0ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.876032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c9403-bf13-47d6-b401-6851baea0ce5 admin admin] PATH_INFO: `/v3/projects/0fe153516fd048e2bbe4d89a6851b0b8/users/87be591561bb400b8c84eeec44b8234d/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:13.879785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627bff6-9a2b-4218-8038-59dbe1b24dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7ed5932615343aa9d806ed2a38c603d, user_id=03d540e2706a4c3491629f6b8fc40ff9, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.881387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WARNING py.warnings [None req-5627bff6-9a2b-4218-8038-59dbe1b24dae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:31:13.881387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: warnings.warn(msg) May 12 14:31:13.881387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: May 12 14:31:13.883598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627bff6-9a2b-4218-8038-59dbe1b24dae admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.891656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c9403-bf13-47d6-b401-6851baea0ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe153516fd048e2bbe4d89a6851b0b8, user_id=87be591561bb400b8c84eeec44b8234d, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:13.894424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c9403-bf13-47d6-b401-6851baea0ce5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:13.897346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 793/1596] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:13 2022] PUT /identity/v3/projects/b7ed5932615343aa9d806ed2a38c603d/users/03d540e2706a4c3491629f6b8fc40ff9/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:13.900117 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627bff6-9a2b-4218-8038-59dbe1b24dae admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.916427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 804/1597] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:13 2022] PUT /identity/v3/projects/0fe153516fd048e2bbe4d89a6851b0b8/users/87be591561bb400b8c84eeec44b8234d/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:13.926645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c9403-bf13-47d6-b401-6851baea0ce5 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:13.965601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627bff6-9a2b-4218-8038-59dbe1b24dae admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.990884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c9403-bf13-47d6-b401-6851baea0ce5 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:13.995608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffd791-d3ba-4f5d-8b93-0fb564eb0065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:13.996533 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffd791-d3ba-4f5d-8b93-0fb564eb0065 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:13.996817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffd791-d3ba-4f5d-8b93-0fb564eb0065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:13.997096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffd791-d3ba-4f5d-8b93-0fb564eb0065 admin admin] PATH_INFO: `/v3/projects/e4b5ca018b5f4dda99486407424b8168/users/c6422873a3b84aac88f8a93291bcd7b0/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.012293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffd791-d3ba-4f5d-8b93-0fb564eb0065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b5ca018b5f4dda99486407424b8168, user_id=c6422873a3b84aac88f8a93291bcd7b0, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.014970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffd791-d3ba-4f5d-8b93-0fb564eb0065 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.020635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf49516-1bfb-4a87-9a1a-1c3cab0d3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.022201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf49516-1bfb-4a87-9a1a-1c3cab0d3e64 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.022403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf49516-1bfb-4a87-9a1a-1c3cab0d3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.022677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf49516-1bfb-4a87-9a1a-1c3cab0d3e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.023439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf49516-1bfb-4a87-9a1a-1c3cab0d3e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.025415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf49516-1bfb-4a87-9a1a-1c3cab0d3e64 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.028730 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 805/1598] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:13 2022] PUT /identity/v3/projects/e4b5ca018b5f4dda99486407424b8168/users/c6422873a3b84aac88f8a93291bcd7b0/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:14.029620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffd791-d3ba-4f5d-8b93-0fb564eb0065 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:14.039620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 794/1599] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:14.041471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab0e6a-fa25-438c-99bd-b49b6d78ebf3 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.041758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab0e6a-fa25-438c-99bd-b49b6d78ebf3 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.042041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab0e6a-fa25-438c-99bd-b49b6d78ebf3 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.043502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 795/1600] 10.222.0.75 () {54 vars in 961 bytes} [Thu May 12 14:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:14.044208 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab0e6a-fa25-438c-99bd-b49b6d78ebf3 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:14.087142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffd791-d3ba-4f5d-8b93-0fb564eb0065 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:14.093210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbe608-631b-4c50-98e7-3ab7c0966657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.094312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbe608-631b-4c50-98e7-3ab7c0966657 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.094800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbe608-631b-4c50-98e7-3ab7c0966657 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.095311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbe608-631b-4c50-98e7-3ab7c0966657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.113100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab0e6a-fa25-438c-99bd-b49b6d78ebf3 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:14.119505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec0c43-be44-4d2b-94d9-9abe86c18b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.120524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec0c43-be44-4d2b-94d9-9abe86c18b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.120954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec0c43-be44-4d2b-94d9-9abe86c18b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.121386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec0c43-be44-4d2b-94d9-9abe86c18b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.122363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec0c43-be44-4d2b-94d9-9abe86c18b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.124057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec0c43-be44-4d2b-94d9-9abe86c18b18 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.135951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 796/1601] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:14.136935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec0c43-be44-4d2b-94d9-9abe86c18b18 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:14.147455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec0c43-be44-4d2b-94d9-9abe86c18b18 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:14.155021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006c023-7427-456b-ae49-40d455f0c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.155711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006c023-7427-456b-ae49-40d455f0c2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.155998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006c023-7427-456b-ae49-40d455f0c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.156280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006c023-7427-456b-ae49-40d455f0c2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.157010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006c023-7427-456b-ae49-40d455f0c2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.158656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006c023-7427-456b-ae49-40d455f0c2e1 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.161543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbe608-631b-4c50-98e7-3ab7c0966657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.162991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbe608-631b-4c50-98e7-3ab7c0966657 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.168699 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 797/1602] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:14.169984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67683fba-d7ed-4212-903d-dc3c2ffd6f99 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.170276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67683fba-d7ed-4212-903d-dc3c2ffd6f99 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.170559 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67683fba-d7ed-4212-903d-dc3c2ffd6f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.172957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 806/1603] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:14.174239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2161c-0626-4a25-8724-fcfa1f6681c6 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.174533 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2161c-0626-4a25-8724-fcfa1f6681c6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.174899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2161c-0626-4a25-8724-fcfa1f6681c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.202541 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-67683fba-d7ed-4212-903d-dc3c2ffd6f99 None None] MFA Rules not processed for user `03d540e2706a4c3491629f6b8fc40ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:14.203540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f1e2161c-0626-4a25-8724-fcfa1f6681c6 None None] MFA Rules not processed for user `87be591561bb400b8c84eeec44b8234d`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:14.203817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-67683fba-d7ed-4212-903d-dc3c2ffd6f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:14.204865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f1e2161c-0626-4a25-8724-fcfa1f6681c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:14.272915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 798/1604] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:14.274964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3550f8-dfec-428a-972f-a9c9b4cbdbfc None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.275485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3550f8-dfec-428a-972f-a9c9b4cbdbfc None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.276079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3550f8-dfec-428a-972f-a9c9b4cbdbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.285756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 807/1605] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:14.286746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2161c-0626-4a25-8724-fcfa1f6681c6 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:14.296128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-ae3550f8-dfec-428a-972f-a9c9b4cbdbfc None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:14.296978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ae3550f8-dfec-428a-972f-a9c9b4cbdbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:14.299814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2161c-0626-4a25-8724-fcfa1f6681c6 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:14.305645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47466f-6f70-4138-8174-4c7813e3eb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.306071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 799/1606] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:14.307565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2559-e6ba-49f3-9645-9a818917cc86 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.307842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2559-e6ba-49f3-9645-9a818917cc86 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.308118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2559-e6ba-49f3-9645-9a818917cc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.309806 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47466f-6f70-4138-8174-4c7813e3eb7b admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.310217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47466f-6f70-4138-8174-4c7813e3eb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.310660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47466f-6f70-4138-8174-4c7813e3eb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.311637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47466f-6f70-4138-8174-4c7813e3eb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.313390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47466f-6f70-4138-8174-4c7813e3eb7b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.328299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 808/1607] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:14.329385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47466f-6f70-4138-8174-4c7813e3eb7b admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:14.329582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-002f2559-e6ba-49f3-9645-9a818917cc86 None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:14.330973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-002f2559-e6ba-49f3-9645-9a818917cc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:14.340967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47466f-6f70-4138-8174-4c7813e3eb7b admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:14.347958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33ea86-aa37-42ad-af7c-48dd0ec3f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.349008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33ea86-aa37-42ad-af7c-48dd0ec3f3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.349295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33ea86-aa37-42ad-af7c-48dd0ec3f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.349577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33ea86-aa37-42ad-af7c-48dd0ec3f3e4 admin admin] PATH_INFO: `/v3/projects/58067412912248f99343bb0d5a31cc8c/users/53f2518ae3014719b789d99b9807ceb4/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.367451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33ea86-aa37-42ad-af7c-48dd0ec3f3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58067412912248f99343bb0d5a31cc8c, user_id=53f2518ae3014719b789d99b9807ceb4, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.370164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed33ea86-aa37-42ad-af7c-48dd0ec3f3e4 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.385974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 809/1608] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:14 2022] PUT /identity/v3/projects/58067412912248f99343bb0d5a31cc8c/users/53f2518ae3014719b789d99b9807ceb4/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:14.387233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33ea86-aa37-42ad-af7c-48dd0ec3f3e4 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:14.414359 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 800/1609] 10.222.0.75 () {58 vars in 1058 bytes} [Thu May 12 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:14.421996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2559-e6ba-49f3-9645-9a818917cc86 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:14.432324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2559-e6ba-49f3-9645-9a818917cc86 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:14.468864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed33ea86-aa37-42ad-af7c-48dd0ec3f3e4 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:14.475160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eefaf7-6cb6-4e82-aea0-71a7eeaff179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.476064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eefaf7-6cb6-4e82-aea0-71a7eeaff179 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.476347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eefaf7-6cb6-4e82-aea0-71a7eeaff179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.476624 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eefaf7-6cb6-4e82-aea0-71a7eeaff179 admin admin] PATH_INFO: `/v3/projects/2fec538bf54949a9b9a1cf1ed60f1dd6/users/8512751e386b4ae988f1ab67e4f8bab9/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.494572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330477-f5e8-4fdf-87d1-817b17585360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.495184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eefaf7-6cb6-4e82-aea0-71a7eeaff179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fec538bf54949a9b9a1cf1ed60f1dd6, user_id=8512751e386b4ae988f1ab67e4f8bab9, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.495416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330477-f5e8-4fdf-87d1-817b17585360 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.495773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330477-f5e8-4fdf-87d1-817b17585360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.496142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2330477-f5e8-4fdf-87d1-817b17585360 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.496923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2330477-f5e8-4fdf-87d1-817b17585360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.497944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eefaf7-6cb6-4e82-aea0-71a7eeaff179 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.498976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2330477-f5e8-4fdf-87d1-817b17585360 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.524541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 810/1610] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:14 2022] PUT /identity/v3/projects/2fec538bf54949a9b9a1cf1ed60f1dd6/users/8512751e386b4ae988f1ab67e4f8bab9/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:14.524541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3a49-c3fa-4b87-ae73-23cc9979dfc3 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.524541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3a49-c3fa-4b87-ae73-23cc9979dfc3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.524541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c3a49-c3fa-4b87-ae73-23cc9979dfc3 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.524541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 811/1611] 10.222.0.75 () {54 vars in 961 bytes} [Thu May 12 14:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:14.524541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3a49-c3fa-4b87-ae73-23cc9979dfc3 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:14.526496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5a2c3a49-c3fa-4b87-ae73-23cc9979dfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:14.538333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 801/1612] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:14 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:14.539380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330477-f5e8-4fdf-87d1-817b17585360 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:14.600597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c3a49-c3fa-4b87-ae73-23cc9979dfc3 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:14.609453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2330477-f5e8-4fdf-87d1-817b17585360 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:14.617347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e7f94-22dc-45c5-8f01-8d2fa5ec381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.619345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e7f94-22dc-45c5-8f01-8d2fa5ec381f admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.619712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e7f94-22dc-45c5-8f01-8d2fa5ec381f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.620069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e7f94-22dc-45c5-8f01-8d2fa5ec381f admin admin] PATH_INFO: `/v3/projects/5595513cb114487cb476e609d069709b/users/1e59323f23bd40928544cfac604a5270/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.638789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e7f94-22dc-45c5-8f01-8d2fa5ec381f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5595513cb114487cb476e609d069709b, user_id=1e59323f23bd40928544cfac604a5270, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.641524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e7f94-22dc-45c5-8f01-8d2fa5ec381f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.658095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8a86-03cc-4f5f-a39a-1da4646198cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.658783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8a86-03cc-4f5f-a39a-1da4646198cb service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.659087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8a86-03cc-4f5f-a39a-1da4646198cb service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.659362 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc8a86-03cc-4f5f-a39a-1da4646198cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.662290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 802/1613] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:14 2022] PUT /identity/v3/projects/5595513cb114487cb476e609d069709b/users/1e59323f23bd40928544cfac604a5270/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:14.664134 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf6412-ab59-4643-a8ff-ae53a6c18db4 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.664510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf6412-ab59-4643-a8ff-ae53a6c18db4 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.664847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf6412-ab59-4643-a8ff-ae53a6c18db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.674789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc8a86-03cc-4f5f-a39a-1da4646198cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.676296 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc8a86-03cc-4f5f-a39a-1da4646198cb service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.700383 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 812/1614] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:14.701376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8a86-03cc-4f5f-a39a-1da4646198cb service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:14.710034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-49bf6412-ab59-4643-a8ff-ae53a6c18db4 None None] MFA Rules not processed for user `53f2518ae3014719b789d99b9807ceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:14.711317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-49bf6412-ab59-4643-a8ff-ae53a6c18db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:14.799930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc8a86-03cc-4f5f-a39a-1da4646198cb service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:14.811728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 803/1615] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:14.818045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724a2c-cbf5-4edc-af68-fdc734473aad None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.818045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724a2c-cbf5-4edc-af68-fdc734473aad None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.818332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724a2c-cbf5-4edc-af68-fdc734473aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.844717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-14724a2c-cbf5-4edc-af68-fdc734473aad None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:14.846148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-14724a2c-cbf5-4edc-af68-fdc734473aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:14.894057 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60305d4-190b-4670-b3b5-e3b2ef1dae82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:14.894793 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60305d4-190b-4670-b3b5-e3b2ef1dae82 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.895059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60305d4-190b-4670-b3b5-e3b2ef1dae82 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.895343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60305d4-190b-4670-b3b5-e3b2ef1dae82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.940974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 804/1616] 10.222.0.75 () {58 vars in 1058 bytes} [Thu May 12 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:14.942348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7421d-8eda-4466-968b-983818d0ddd1 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:14.942733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7421d-8eda-4466-968b-983818d0ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:14.943538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7421d-8eda-4466-968b-983818d0ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:14.978181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-f2f7421d-8eda-4466-968b-983818d0ddd1 None None] MFA Rules not processed for user `8512751e386b4ae988f1ab67e4f8bab9`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:14.979450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f2f7421d-8eda-4466-968b-983818d0ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:14.982358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60305d4-190b-4670-b3b5-e3b2ef1dae82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:14.984209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60305d4-190b-4670-b3b5-e3b2ef1dae82 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:14.996071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 813/1617] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:14.996071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60305d4-190b-4670-b3b5-e3b2ef1dae82 service nova] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.078278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60305d4-190b-4670-b3b5-e3b2ef1dae82 service nova] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.079773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 805/1618] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:15.081647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b9342-799f-4e91-84ee-09db6e2e202c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.082087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b9342-799f-4e91-84ee-09db6e2e202c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.082465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b9342-799f-4e91-84ee-09db6e2e202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.086059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4982-5cf6-40ca-95a1-e88fa2b4bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.086921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4982-5cf6-40ca-95a1-e88fa2b4bdfe admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.087510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4982-5cf6-40ca-95a1-e88fa2b4bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.087964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae4982-5cf6-40ca-95a1-e88fa2b4bdfe admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.088945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4982-5cf6-40ca-95a1-e88fa2b4bdfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.091189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae4982-5cf6-40ca-95a1-e88fa2b4bdfe admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.104533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b18b9342-799f-4e91-84ee-09db6e2e202c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:15.106231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b18b9342-799f-4e91-84ee-09db6e2e202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:15.115204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 814/1619] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:14 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:15.116270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4982-5cf6-40ca-95a1-e88fa2b4bdfe admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.119300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 806/1620] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:15.120850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b9342-799f-4e91-84ee-09db6e2e202c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.129424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae4982-5cf6-40ca-95a1-e88fa2b4bdfe admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.136553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a51ab-9f94-4ee0-b463-f3d0d194e1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.136883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b9342-799f-4e91-84ee-09db6e2e202c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.137202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a51ab-9f94-4ee0-b463-f3d0d194e1fc admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.137494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a51ab-9f94-4ee0-b463-f3d0d194e1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.137769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a51ab-9f94-4ee0-b463-f3d0d194e1fc admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.138620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a51ab-9f94-4ee0-b463-f3d0d194e1fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.140700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a51ab-9f94-4ee0-b463-f3d0d194e1fc admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.144143 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3145b-b77c-4086-b025-047d32b73e04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.144917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3145b-b77c-4086-b025-047d32b73e04 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.145307 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3145b-b77c-4086-b025-047d32b73e04 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.145691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3145b-b77c-4086-b025-047d32b73e04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.182722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 815/1621] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:15 2022] POST /identity/v3/projects => generated 405 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:15.184555 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a51ab-9f94-4ee0-b463-f3d0d194e1fc admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.224314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3145b-b77c-4086-b025-047d32b73e04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.226301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3145b-b77c-4086-b025-047d32b73e04 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.238023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 807/1622] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:15.239204 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3145b-b77c-4086-b025-047d32b73e04 service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.251531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3145b-b77c-4086-b025-047d32b73e04 service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.332231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4000e67-8f7f-4b11-bb16-d570b42b2658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.333481 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4000e67-8f7f-4b11-bb16-d570b42b2658 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.333873 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4000e67-8f7f-4b11-bb16-d570b42b2658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.334318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4000e67-8f7f-4b11-bb16-d570b42b2658 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.335235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4000e67-8f7f-4b11-bb16-d570b42b2658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.337021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4000e67-8f7f-4b11-bb16-d570b42b2658 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.351248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 808/1623] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:15.355817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4000e67-8f7f-4b11-bb16-d570b42b2658 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.413922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a51ab-9f94-4ee0-b463-f3d0d194e1fc admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.419075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3682-38d9-4b75-8cae-40d438621b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.420030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3682-38d9-4b75-8cae-40d438621b3a admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.420427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3682-38d9-4b75-8cae-40d438621b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.421311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a3682-38d9-4b75-8cae-40d438621b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.422951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a3682-38d9-4b75-8cae-40d438621b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.433917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a3682-38d9-4b75-8cae-40d438621b3a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.450180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4000e67-8f7f-4b11-bb16-d570b42b2658 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.463302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668d7f2-1661-4da6-ac35-ff902a493e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.463982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668d7f2-1661-4da6-ac35-ff902a493e0f service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.464272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668d7f2-1661-4da6-ac35-ff902a493e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.464554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668d7f2-1661-4da6-ac35-ff902a493e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.483697 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668d7f2-1661-4da6-ac35-ff902a493e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.487570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668d7f2-1661-4da6-ac35-ff902a493e0f service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.498062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 816/1624] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:15 2022] POST /identity/v3/projects => generated 363 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:15.499850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3682-38d9-4b75-8cae-40d438621b3a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.513633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 809/1625] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:15.515939 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf71253-e52c-496f-9a57-37d1dbbb3a30 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.517386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf71253-e52c-496f-9a57-37d1dbbb3a30 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.517683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf71253-e52c-496f-9a57-37d1dbbb3a30 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.519595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 810/1626] 10.222.0.75 () {54 vars in 912 bytes} [Thu May 12 14:31:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:15.522616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf71253-e52c-496f-9a57-37d1dbbb3a30 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.615626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a3682-38d9-4b75-8cae-40d438621b3a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.620785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d56b92-db59-49d6-a3cd-7a1321e4a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.621459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d56b92-db59-49d6-a3cd-7a1321e4a657 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.621743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d56b92-db59-49d6-a3cd-7a1321e4a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.622018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d56b92-db59-49d6-a3cd-7a1321e4a657 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.622760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d56b92-db59-49d6-a3cd-7a1321e4a657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.624926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d56b92-db59-49d6-a3cd-7a1321e4a657 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.651308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 817/1627] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:15 2022] POST /identity/v3/users => generated 309 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:15.652426 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d56b92-db59-49d6-a3cd-7a1321e4a657 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.664700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf71253-e52c-496f-9a57-37d1dbbb3a30 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.667480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d56b92-db59-49d6-a3cd-7a1321e4a657 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.673938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12526bc9-9496-4164-ba90-8e9b710b3592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.674855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12526bc9-9496-4164-ba90-8e9b710b3592 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.675407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12526bc9-9496-4164-ba90-8e9b710b3592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.675623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8798f-8512-4e83-9cb9-1fbecd38acf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.675758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12526bc9-9496-4164-ba90-8e9b710b3592 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.677018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12526bc9-9496-4164-ba90-8e9b710b3592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.677246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8798f-8512-4e83-9cb9-1fbecd38acf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.677246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8798f-8512-4e83-9cb9-1fbecd38acf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.677540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8798f-8512-4e83-9cb9-1fbecd38acf0 admin admin] PATH_INFO: `/v3/projects/af9b44c97df34eb988e8ea71233c037d/users/b5291a94522d4f8fbbd3faf2df6414f1/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.679060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12526bc9-9496-4164-ba90-8e9b710b3592 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.714444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8798f-8512-4e83-9cb9-1fbecd38acf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9b44c97df34eb988e8ea71233c037d, user_id=b5291a94522d4f8fbbd3faf2df6414f1, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.720531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8798f-8512-4e83-9cb9-1fbecd38acf0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.721540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 818/1628] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:15 2022] POST /identity/v3/users => generated 288 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:15.725891 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c7cd5-2212-488d-8cbb-77800b04870b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.726189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c7cd5-2212-488d-8cbb-77800b04870b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.726470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c7cd5-2212-488d-8cbb-77800b04870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.751118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b33c7cd5-2212-488d-8cbb-77800b04870b None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:15.752815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b33c7cd5-2212-488d-8cbb-77800b04870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:15.756622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 811/1629] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:15 2022] PUT /identity/v3/projects/af9b44c97df34eb988e8ea71233c037d/users/b5291a94522d4f8fbbd3faf2df6414f1/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:15.757772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8798f-8512-4e83-9cb9-1fbecd38acf0 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.848202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 819/1630] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:15.849596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c7cd5-2212-488d-8cbb-77800b04870b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.852302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8798f-8512-4e83-9cb9-1fbecd38acf0 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.865377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c7cd5-2212-488d-8cbb-77800b04870b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.865791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900bc7f-4c27-4ea8-97d7-a1eeabea1709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.866556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900bc7f-4c27-4ea8-97d7-a1eeabea1709 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.866842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900bc7f-4c27-4ea8-97d7-a1eeabea1709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.867145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900bc7f-4c27-4ea8-97d7-a1eeabea1709 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.867957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900bc7f-4c27-4ea8-97d7-a1eeabea1709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.869724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900bc7f-4c27-4ea8-97d7-a1eeabea1709 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.871210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83624ea-17a1-48f6-afd6-e27bd47655fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.871899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83624ea-17a1-48f6-afd6-e27bd47655fe admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.872331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83624ea-17a1-48f6-afd6-e27bd47655fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.872621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83624ea-17a1-48f6-afd6-e27bd47655fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.873376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83624ea-17a1-48f6-afd6-e27bd47655fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.874993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83624ea-17a1-48f6-afd6-e27bd47655fe admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.885479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 812/1631] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:15.885479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db1401-f99e-43d1-8eb2-cef0d0ccce87 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.885479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db1401-f99e-43d1-8eb2-cef0d0ccce87 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.885479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db1401-f99e-43d1-8eb2-cef0d0ccce87 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.887163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 813/1632] 10.222.0.75 () {54 vars in 912 bytes} [Thu May 12 14:31:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:15.887360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 820/1633] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:15.887992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db1401-f99e-43d1-8eb2-cef0d0ccce87 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.888213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83624ea-17a1-48f6-afd6-e27bd47655fe admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.904859 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db1401-f99e-43d1-8eb2-cef0d0ccce87 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.910192 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed79031-469c-47d5-a1da-d9cb51b69ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.911159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed79031-469c-47d5-a1da-d9cb51b69ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.912132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed79031-469c-47d5-a1da-d9cb51b69ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.912750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed79031-469c-47d5-a1da-d9cb51b69ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.913598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed79031-469c-47d5-a1da-d9cb51b69ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.916076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed79031-469c-47d5-a1da-d9cb51b69ab1 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.929285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 814/1634] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:15.930210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed79031-469c-47d5-a1da-d9cb51b69ab1 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:15.945787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed79031-469c-47d5-a1da-d9cb51b69ab1 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.951264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed311d5c-ef04-4b9d-b5b8-69209dbf9c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.952690 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed311d5c-ef04-4b9d-b5b8-69209dbf9c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.953063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed311d5c-ef04-4b9d-b5b8-69209dbf9c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.953558 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed311d5c-ef04-4b9d-b5b8-69209dbf9c0f admin admin] PATH_INFO: `/v3/projects/61c5391796034b64970131ad77213c3b/users/f2ee3634940046b69884f2c8616b78c7/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.954975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83624ea-17a1-48f6-afd6-e27bd47655fe admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:15.960090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cef1d-7fe0-4ecb-b24e-0fcb65899872 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:15.960941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cef1d-7fe0-4ecb-b24e-0fcb65899872 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:15.961238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cef1d-7fe0-4ecb-b24e-0fcb65899872 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:15.961522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cef1d-7fe0-4ecb-b24e-0fcb65899872 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:15.976109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cef1d-7fe0-4ecb-b24e-0fcb65899872 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.976572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed311d5c-ef04-4b9d-b5b8-69209dbf9c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c5391796034b64970131ad77213c3b, user_id=f2ee3634940046b69884f2c8616b78c7, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:15.977525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cef1d-7fe0-4ecb-b24e-0fcb65899872 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.980299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed311d5c-ef04-4b9d-b5b8-69209dbf9c0f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:15.989448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 821/1635] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:15.990051 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cef1d-7fe0-4ecb-b24e-0fcb65899872 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:16.000497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cef1d-7fe0-4ecb-b24e-0fcb65899872 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:16.005607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dedef6-a77e-40e0-8c2f-533cf71a5b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:16.006529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dedef6-a77e-40e0-8c2f-533cf71a5b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.006786 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dedef6-a77e-40e0-8c2f-533cf71a5b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.007100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dedef6-a77e-40e0-8c2f-533cf71a5b8e admin admin] PATH_INFO: `/v3/projects/abc507c31e514b4bb6c962875caf9bdd/users/a4a708a96d914473965561f196f1b1a4/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:16.023233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 815/1636] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:15 2022] PUT /identity/v3/projects/61c5391796034b64970131ad77213c3b/users/f2ee3634940046b69884f2c8616b78c7/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:16.024458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dedef6-a77e-40e0-8c2f-533cf71a5b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc507c31e514b4bb6c962875caf9bdd, user_id=a4a708a96d914473965561f196f1b1a4, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:16.025355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0c64d-b1d9-42f9-8007-8340c7605bd3 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.025713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0c64d-b1d9-42f9-8007-8340c7605bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.026152 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0c64d-b1d9-42f9-8007-8340c7605bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:16.027204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dedef6-a77e-40e0-8c2f-533cf71a5b8e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:16.060110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 822/1637] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:15 2022] PUT /identity/v3/projects/abc507c31e514b4bb6c962875caf9bdd/users/a4a708a96d914473965561f196f1b1a4/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:16.061930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dedef6-a77e-40e0-8c2f-533cf71a5b8e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:16.064191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-6ec0c64d-b1d9-42f9-8007-8340c7605bd3 None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:16.065837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6ec0c64d-b1d9-42f9-8007-8340c7605bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:16.167481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dedef6-a77e-40e0-8c2f-533cf71a5b8e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:16.173468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f1f9f-4b9c-464d-b446-fc0462c0a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:16.176211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f1f9f-4b9c-464d-b446-fc0462c0a3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.176211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f1f9f-4b9c-464d-b446-fc0462c0a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.176211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f1f9f-4b9c-464d-b446-fc0462c0a3ce admin admin] PATH_INFO: `/v3/projects/af9b44c97df34eb988e8ea71233c037d/users/b5291a94522d4f8fbbd3faf2df6414f1/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:16.181643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f1f9f-4b9c-464d-b446-fc0462c0a3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9b44c97df34eb988e8ea71233c037d, user_id=b5291a94522d4f8fbbd3faf2df6414f1, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:16.185073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f1f9f-4b9c-464d-b446-fc0462c0a3ce admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:16.201934 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 823/1638] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:16 2022] PUT /identity/v3/projects/af9b44c97df34eb988e8ea71233c037d/users/b5291a94522d4f8fbbd3faf2df6414f1/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:16.203289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f1f9f-4b9c-464d-b446-fc0462c0a3ce admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:16.210803 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 816/1639] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:16.212533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0c64d-b1d9-42f9-8007-8340c7605bd3 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:16.266416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0c64d-b1d9-42f9-8007-8340c7605bd3 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:16.349440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f1f9f-4b9c-464d-b446-fc0462c0a3ce admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:16.354784 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6a6870-63ef-4469-bc98-c2520eaf04f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:16.355364 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a6870-63ef-4469-bc98-c2520eaf04f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.355642 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a6870-63ef-4469-bc98-c2520eaf04f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.355917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6a6870-63ef-4469-bc98-c2520eaf04f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:16.356710 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a6870-63ef-4469-bc98-c2520eaf04f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:16.359102 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6a6870-63ef-4469-bc98-c2520eaf04f2 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:16.384205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 824/1640] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:16.385623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc3cbf-7a4e-4e61-bb31-0ff39b92e51c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.385909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc3cbf-7a4e-4e61-bb31-0ff39b92e51c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.386190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc3cbf-7a4e-4e61-bb31-0ff39b92e51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:16.419548 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-23bc3cbf-7a4e-4e61-bb31-0ff39b92e51c None None] MFA Rules not processed for user `b5291a94522d4f8fbbd3faf2df6414f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:16.420743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-23bc3cbf-7a4e-4e61-bb31-0ff39b92e51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:16.471798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c76b99-8a8b-4e85-ab35-8663ed3829ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:16.472647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76b99-8a8b-4e85-ab35-8663ed3829ab admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.472773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76b99-8a8b-4e85-ab35-8663ed3829ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.473108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76b99-8a8b-4e85-ab35-8663ed3829ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:16.478909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c76b99-8a8b-4e85-ab35-8663ed3829ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:16.480617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c76b99-8a8b-4e85-ab35-8663ed3829ab admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:16.502844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 817/1641] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:16.503850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c76b99-8a8b-4e85-ab35-8663ed3829ab admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:16.525276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 825/1642] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:16.526105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc3cbf-7a4e-4e61-bb31-0ff39b92e51c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:16.537627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc3cbf-7a4e-4e61-bb31-0ff39b92e51c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:16.548593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2643bf-c65a-4238-8118-2b2ebd3bc635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:16.549504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2643bf-c65a-4238-8118-2b2ebd3bc635 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.549791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2643bf-c65a-4238-8118-2b2ebd3bc635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.550053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2643bf-c65a-4238-8118-2b2ebd3bc635 admin admin] PATH_INFO: `/v3/projects/61c5391796034b64970131ad77213c3b/users/f2ee3634940046b69884f2c8616b78c7/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:16.553614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2643bf-c65a-4238-8118-2b2ebd3bc635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c5391796034b64970131ad77213c3b, user_id=f2ee3634940046b69884f2c8616b78c7, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:16.556349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2643bf-c65a-4238-8118-2b2ebd3bc635 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:16.576712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 826/1643] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:16 2022] PUT /identity/v3/projects/61c5391796034b64970131ad77213c3b/users/f2ee3634940046b69884f2c8616b78c7/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:16.587486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2643bf-c65a-4238-8118-2b2ebd3bc635 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:16.611347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c76b99-8a8b-4e85-ab35-8663ed3829ab admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:16.719499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2643bf-c65a-4238-8118-2b2ebd3bc635 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:16.725129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ad958-fbd0-4aad-8c67-d62f030b3e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:16.726256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ad958-fbd0-4aad-8c67-d62f030b3e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.726538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ad958-fbd0-4aad-8c67-d62f030b3e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.726813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ad958-fbd0-4aad-8c67-d62f030b3e01 admin admin] PATH_INFO: `/v3/projects/abc507c31e514b4bb6c962875caf9bdd/users/a4a708a96d914473965561f196f1b1a4/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:16.729767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ad958-fbd0-4aad-8c67-d62f030b3e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abc507c31e514b4bb6c962875caf9bdd, user_id=a4a708a96d914473965561f196f1b1a4, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:16.732818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ad958-fbd0-4aad-8c67-d62f030b3e01 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:16.772275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9076ed-43ce-4dc1-a71c-3157051c8eac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:16.773105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9076ed-43ce-4dc1-a71c-3157051c8eac service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.773387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9076ed-43ce-4dc1-a71c-3157051c8eac service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.773837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9076ed-43ce-4dc1-a71c-3157051c8eac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:16.778714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 827/1644] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:16 2022] PUT /identity/v3/projects/abc507c31e514b4bb6c962875caf9bdd/users/a4a708a96d914473965561f196f1b1a4/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:16.782372 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f3e45-a19f-4483-a81c-aa0d97a4e924 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.782849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f3e45-a19f-4483-a81c-aa0d97a4e924 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.789321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f3e45-a19f-4483-a81c-aa0d97a4e924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:16.900116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a39f3e45-a19f-4483-a81c-aa0d97a4e924 None None] MFA Rules not processed for user `f2ee3634940046b69884f2c8616b78c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:16.901356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a39f3e45-a19f-4483-a81c-aa0d97a4e924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:16.950133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9076ed-43ce-4dc1-a71c-3157051c8eac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:16.955557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9076ed-43ce-4dc1-a71c-3157051c8eac service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:16.985346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 818/1645] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:16.986700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6c843-103c-4f46-841c-ddad5d12aa08 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:16.987062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6c843-103c-4f46-841c-ddad5d12aa08 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:16.987300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6c843-103c-4f46-841c-ddad5d12aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:17.051752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-16f6c843-103c-4f46-841c-ddad5d12aa08 None None] MFA Rules not processed for user `a4a708a96d914473965561f196f1b1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:17.053725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-16f6c843-103c-4f46-841c-ddad5d12aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:17.087166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 828/1646] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:17.173242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f3e45-a19f-4483-a81c-aa0d97a4e924 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:17.295611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 819/1647] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:17.311670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f3e45-a19f-4483-a81c-aa0d97a4e924 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:17.325216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f34bd-3d6e-449d-9c87-4b0f2164c042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:17.325910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f34bd-3d6e-449d-9c87-4b0f2164c042 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:17.326196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f34bd-3d6e-449d-9c87-4b0f2164c042 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:17.326469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f34bd-3d6e-449d-9c87-4b0f2164c042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:17.478897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f34bd-3d6e-449d-9c87-4b0f2164c042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:17.482844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f34bd-3d6e-449d-9c87-4b0f2164c042 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:17.511536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 829/1648] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:17.615777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6c843-103c-4f46-841c-ddad5d12aa08 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:17.658596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6c843-103c-4f46-841c-ddad5d12aa08 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:17.676351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07a2f9-f4cc-4393-9975-cf1815d047cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:17.681819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a2f9-f4cc-4393-9975-cf1815d047cd service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:17.685833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a2f9-f4cc-4393-9975-cf1815d047cd service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:17.686446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07a2f9-f4cc-4393-9975-cf1815d047cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:17.743240 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07a2f9-f4cc-4393-9975-cf1815d047cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:17.753379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07a2f9-f4cc-4393-9975-cf1815d047cd service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:17.787157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 820/1649] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:17 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:17.941306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f34bd-3d6e-449d-9c87-4b0f2164c042 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:17.950769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f34bd-3d6e-449d-9c87-4b0f2164c042 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:17.973137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c091f-e1ac-472e-ad10-194c1757cc48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:17.974773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c091f-e1ac-472e-ad10-194c1757cc48 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:17.975316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c091f-e1ac-472e-ad10-194c1757cc48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:17.975801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c091f-e1ac-472e-ad10-194c1757cc48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:17.991288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c091f-e1ac-472e-ad10-194c1757cc48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:17.992664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c091f-e1ac-472e-ad10-194c1757cc48 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:18.005521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 830/1650] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:17 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:18.639981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07a2f9-f4cc-4393-9975-cf1815d047cd service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:18.912870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07a2f9-f4cc-4393-9975-cf1815d047cd service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:18.922040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:18.923401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:18.923877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:18.924913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] PATH_INFO: `/v3/users/53f2518ae3014719b789d99b9807ceb4` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:18.926438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53f2518ae3014719b789d99b9807ceb4)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:18.928362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: WARNING py.warnings [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:31:18.928362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: warnings.warn(msg) May 12 14:31:18.928362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: May 12 14:31:18.930345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:19.102837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53f2518ae3014719b789d99b9807ceb4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:19.103715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53f2518ae3014719b789d99b9807ceb4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:19.135802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53f2518ae3014719b789d99b9807ceb4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:19.144178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53f2518ae3014719b789d99b9807ceb4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:19.164188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-82974664-f516-4651-934c-300916a8fca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53f2518ae3014719b789d99b9807ceb4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:19.234029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 821/1651] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:18 2022] DELETE /identity/v3/users/53f2518ae3014719b789d99b9807ceb4 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:19.237450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed8459-89e9-43ce-9b1d-b043980cd30c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:19.238984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed8459-89e9-43ce-9b1d-b043980cd30c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:19.240283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed8459-89e9-43ce-9b1d-b043980cd30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:19.267542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b204-f94e-45a9-898b-c9cf165ee11a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:19.268192 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b204-f94e-45a9-898b-c9cf165ee11a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:19.269023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b204-f94e-45a9-898b-c9cf165ee11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:19.293420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a5ed8459-89e9-43ce-9b1d-b043980cd30c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:19.294091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a5ed8459-89e9-43ce-9b1d-b043980cd30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:19.325659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-12c4b204-f94e-45a9-898b-c9cf165ee11a None None] MFA Rules not processed for user `1e59323f23bd40928544cfac604a5270`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:19.328489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-12c4b204-f94e-45a9-898b-c9cf165ee11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:19.464198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 831/1652] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:19.470129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed8459-89e9-43ce-9b1d-b043980cd30c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:19.487081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 822/1653] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:19.496418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac0532-2d60-481c-8a3e-2e15fa324694 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:19.496418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac0532-2d60-481c-8a3e-2e15fa324694 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:19.496418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac0532-2d60-481c-8a3e-2e15fa324694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:19.498266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a5ed8459-89e9-43ce-9b1d-b043980cd30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:19.520865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed8459-89e9-43ce-9b1d-b043980cd30c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:19.529466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:19.530789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:19.531737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:19.532318 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] PATH_INFO: `/v3/users/87be591561bb400b8c84eeec44b8234d` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:19.534059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87be591561bb400b8c84eeec44b8234d)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:19.536436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:19.662577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87be591561bb400b8c84eeec44b8234d'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:19.692001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87be591561bb400b8c84eeec44b8234d'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:19.693381 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87be591561bb400b8c84eeec44b8234d'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:19.694028 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87be591561bb400b8c84eeec44b8234d'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:19.733668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87be591561bb400b8c84eeec44b8234d'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:19.744871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-6bac0532-2d60-481c-8a3e-2e15fa324694 None None] MFA Rules not processed for user `1e59323f23bd40928544cfac604a5270`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:19.746874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6bac0532-2d60-481c-8a3e-2e15fa324694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:19.763404 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 832/1654] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:19 2022] DELETE /identity/v3/users/87be591561bb400b8c84eeec44b8234d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:19.764648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:19.765456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 823/1655] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:19.766590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac0532-2d60-481c-8a3e-2e15fa324694 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:19.774126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:19.777852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6bac0532-2d60-481c-8a3e-2e15fa324694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:19.930113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac0532-2d60-481c-8a3e-2e15fa324694 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:19.931640 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf1a68-dad9-4c2b-a77a-16b61458579c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:19.945850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:19.946899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:19.947397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:19.947864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] PATH_INFO: `/v3/users/8512751e386b4ae988f1ab67e4f8bab9` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:19.949204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8512751e386b4ae988f1ab67e4f8bab9)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:19.951493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:20.049717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc0eb9-feda-465d-9b20-3ca905a1e4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:20.050359 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0eb9-feda-465d-9b20-3ca905a1e4ba service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:20.050643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0eb9-feda-465d-9b20-3ca905a1e4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:20.050994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0eb9-feda-465d-9b20-3ca905a1e4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:20.053934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-abbc0eb9-feda-465d-9b20-3ca905a1e4ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:20.057044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8512751e386b4ae988f1ab67e4f8bab9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:20.077974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8512751e386b4ae988f1ab67e4f8bab9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:20.078222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc0eb9-feda-465d-9b20-3ca905a1e4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:20.080231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc0eb9-feda-465d-9b20-3ca905a1e4ba service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:20.084306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8512751e386b4ae988f1ab67e4f8bab9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:20.085680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8512751e386b4ae988f1ab67e4f8bab9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:20.094498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 824/1656] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:20.097411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9354-8ed5-485f-83d6-4f22aeb4c96c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:20.097782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9354-8ed5-485f-83d6-4f22aeb4c96c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:20.098510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf9354-8ed5-485f-83d6-4f22aeb4c96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:20.116980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9814bebc-f1d9-44c0-b4d2-530ea40c2598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8512751e386b4ae988f1ab67e4f8bab9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:20.124967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c8bf9354-8ed5-485f-83d6-4f22aeb4c96c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:20.126618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c8bf9354-8ed5-485f-83d6-4f22aeb4c96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:20.140900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 825/1657] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:20.142190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf9354-8ed5-485f-83d6-4f22aeb4c96c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:20.149663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c8bf9354-8ed5-485f-83d6-4f22aeb4c96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:20.153388 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 833/1658] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:19 2022] DELETE /identity/v3/users/8512751e386b4ae988f1ab67e4f8bab9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:20.154833 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d206cd6-46cb-4036-8922-45def52ae057 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:20.155579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d206cd6-46cb-4036-8922-45def52ae057 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:20.155872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d206cd6-46cb-4036-8922-45def52ae057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:20.194267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-3d206cd6-46cb-4036-8922-45def52ae057 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:20.198367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3d206cd6-46cb-4036-8922-45def52ae057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:20.276718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf9354-8ed5-485f-83d6-4f22aeb4c96c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:20.390831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0af3d-3893-4457-a9cb-99961d96019c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:20.391737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0af3d-3893-4457-a9cb-99961d96019c service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:20.392106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0af3d-3893-4457-a9cb-99961d96019c service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:20.392482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0af3d-3893-4457-a9cb-99961d96019c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:20.398294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 834/1659] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:20.398833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-40e0af3d-3893-4457-a9cb-99961d96019c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:20.398938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d206cd6-46cb-4036-8922-45def52ae057 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:20.398938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3d206cd6-46cb-4036-8922-45def52ae057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:20.507684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0af3d-3893-4457-a9cb-99961d96019c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:20.509732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0af3d-3893-4457-a9cb-99961d96019c service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:20.526076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 826/1660] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:20.527698 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0af3d-3893-4457-a9cb-99961d96019c service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:20.543129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d206cd6-46cb-4036-8922-45def52ae057 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:20.546114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0af3d-3893-4457-a9cb-99961d96019c service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:20.552368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcc30b-7c1e-4e23-829a-4db429742837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:20.554266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcc30b-7c1e-4e23-829a-4db429742837 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:20.555199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c9cd7-c000-40fc-9a57-dfaa9dd5bd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:20.555980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9cd7-c000-40fc-9a57-dfaa9dd5bd5d service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:20.556359 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9cd7-c000-40fc-9a57-dfaa9dd5bd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:20.556782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c9cd7-c000-40fc-9a57-dfaa9dd5bd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:20.560942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcc30b-7c1e-4e23-829a-4db429742837 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:20.561579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcc30b-7c1e-4e23-829a-4db429742837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:20.568999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c9cd7-c000-40fc-9a57-dfaa9dd5bd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:20.570749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c9cd7-c000-40fc-9a57-dfaa9dd5bd5d service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:20.582443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 827/1661] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:20.608925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcc30b-7c1e-4e23-829a-4db429742837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:20.611555 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcc30b-7c1e-4e23-829a-4db429742837 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:20.632865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 835/1662] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:20.896825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c9cd7-c000-40fc-9a57-dfaa9dd5bd5d service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:20.896825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9b9c9cd7-c000-40fc-9a57-dfaa9dd5bd5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:20.910892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c9cd7-c000-40fc-9a57-dfaa9dd5bd5d service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:20.921555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:20.925251 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:20.925670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:20.926141 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] PATH_INFO: `/v3/users/dfb54adc3da14a21a903d9025ad60881` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:20.937882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb54adc3da14a21a903d9025ad60881)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:20.940261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:21.048071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb54adc3da14a21a903d9025ad60881'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.049971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb54adc3da14a21a903d9025ad60881'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.070264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb54adc3da14a21a903d9025ad60881'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.071071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb54adc3da14a21a903d9025ad60881'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.088587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb54adc3da14a21a903d9025ad60881'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.120956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 828/1663] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:20 2022] DELETE /identity/v3/users/dfb54adc3da14a21a903d9025ad60881 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:21.125069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43fe1-eef4-4e3e-8820-f3412e28484d None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:21.125366 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43fe1-eef4-4e3e-8820-f3412e28484d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:21.125646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43fe1-eef4-4e3e-8820-f3412e28484d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:21.158855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-3cc43fe1-eef4-4e3e-8820-f3412e28484d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:21.160098 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3cc43fe1-eef4-4e3e-8820-f3412e28484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:21.321566 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 836/1664] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:21.388870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:21.390919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:21.522877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79deef5-d91c-4ebd-a616-beaf1a148aa3 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:21.537350 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddde8a-25de-4799-bd65-cb30c5fdfde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:21.538132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddde8a-25de-4799-bd65-cb30c5fdfde9 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:21.538532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddde8a-25de-4799-bd65-cb30c5fdfde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:21.541196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddde8a-25de-4799-bd65-cb30c5fdfde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:21.568731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddde8a-25de-4799-bd65-cb30c5fdfde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:21.576581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddde8a-25de-4799-bd65-cb30c5fdfde9 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:21.607520 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 829/1665] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:21.613630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc43fe1-eef4-4e3e-8820-f3412e28484d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:21.615168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3cc43fe1-eef4-4e3e-8820-f3412e28484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:21.634549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc43fe1-eef4-4e3e-8820-f3412e28484d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:21.648723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:21.649287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddde8a-25de-4799-bd65-cb30c5fdfde9 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:21.649608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:21.649894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:21.650174 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] PATH_INFO: `/v3/projects/0fe153516fd048e2bbe4d89a6851b0b8` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:21.650825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e3ddde8a-25de-4799-bd65-cb30c5fdfde9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:21.654599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe153516fd048e2bbe4d89a6851b0b8)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:21.655842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: WARNING py.warnings [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 12 14:31:21.655842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: warnings.warn(msg) May 12 14:31:21.655842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: May 12 14:31:21.657059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:21.671301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddde8a-25de-4799-bd65-cb30c5fdfde9 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:21.694387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:21.701654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:21.702338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:21.703465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] PATH_INFO: `/v3/projects/58067412912248f99343bb0d5a31cc8c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:21.712357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] RBAC: Authorizing `identity:delete_project(project_id=58067412912248f99343bb0d5a31cc8c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:21.717628 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:21.779916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe153516fd048e2bbe4d89a6851b0b8', 'request_id': 'req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.796799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe153516fd048e2bbe4d89a6851b0b8', 'request_id': 'req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.807906 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe153516fd048e2bbe4d89a6851b0b8', 'request_id': 'req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.839428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58067412912248f99343bb0d5a31cc8c', 'request_id': 'req-e503f4f6-49c1-4359-ac69-cd9db7cf622b'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.845375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] The token cache is being invalidate because project 0fe153516fd048e2bbe4d89a6851b0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:21.845875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.850397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.852284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 837/1666] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:21 2022] DELETE /identity/v3/projects/0fe153516fd048e2bbe4d89a6851b0b8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:21.857604 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58067412912248f99343bb0d5a31cc8c', 'request_id': 'req-e503f4f6-49c1-4359-ac69-cd9db7cf622b'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.858298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:21.860490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:21.876318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58067412912248f99343bb0d5a31cc8c', 'request_id': 'req-e503f4f6-49c1-4359-ac69-cd9db7cf622b'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.904086 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] The token cache is being invalidate because project 58067412912248f99343bb0d5a31cc8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:21.904711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.905556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:21.908061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 830/1667] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:21 2022] DELETE /identity/v3/projects/58067412912248f99343bb0d5a31cc8c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:21.913048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:21.919493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:22.031733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1f485-314c-4df1-8c4c-725d8b5d6e3c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:22.079997 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503f4f6-49c1-4359-ac69-cd9db7cf622b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:22.091501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:22.091969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:22.098989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:22.099560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] PATH_INFO: `/v3/users/f2ee3634940046b69884f2c8616b78c7` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:22.101186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ee3634940046b69884f2c8616b78c7)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:22.103474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:22.160543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:22.161513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:22.161812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:22.162076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] PATH_INFO: `/v3/users/b5291a94522d4f8fbbd3faf2df6414f1` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:22.165142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5291a94522d4f8fbbd3faf2df6414f1)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:22.167237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:22.240112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ee3634940046b69884f2c8616b78c7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:22.241860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ee3634940046b69884f2c8616b78c7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:22.263986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ee3634940046b69884f2c8616b78c7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:22.264929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ee3634940046b69884f2c8616b78c7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:22.287983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-088ade52-162e-4b66-9c73-7ad2a8fd8e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ee3634940046b69884f2c8616b78c7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:22.289837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5291a94522d4f8fbbd3faf2df6414f1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:22.310645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5291a94522d4f8fbbd3faf2df6414f1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:22.313567 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5291a94522d4f8fbbd3faf2df6414f1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:22.314786 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5291a94522d4f8fbbd3faf2df6414f1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:22.324296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 831/1668] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:21 2022] DELETE /identity/v3/users/f2ee3634940046b69884f2c8616b78c7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:22.348005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890e1779-da32-48cf-9689-d7f3a31e875e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5291a94522d4f8fbbd3faf2df6414f1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:22.375426 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 838/1669] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:21 2022] DELETE /identity/v3/users/b5291a94522d4f8fbbd3faf2df6414f1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:22.581264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557a6c-facc-4722-afe2-d4bdb8a2a67a None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:22.582071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557a6c-facc-4722-afe2-d4bdb8a2a67a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:22.582071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15557a6c-facc-4722-afe2-d4bdb8a2a67a None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:22.583923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 832/1670] 10.222.0.75 () {54 vars in 912 bytes} [Thu May 12 14:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:22.593577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17811c-6c77-4236-81e3-58c8af32a529 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:22.594112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17811c-6c77-4236-81e3-58c8af32a529 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:22.594523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17811c-6c77-4236-81e3-58c8af32a529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:22.663676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-3f17811c-6c77-4236-81e3-58c8af32a529 None None] MFA Rules not processed for user `5aca248c2e074fc4baff39930e21fe29`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:22.665652 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3f17811c-6c77-4236-81e3-58c8af32a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:22.812217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 839/1671] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:31:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:22.860832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15557a6c-facc-4722-afe2-d4bdb8a2a67a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:22.862636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-15557a6c-facc-4722-afe2-d4bdb8a2a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:22.878862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17811c-6c77-4236-81e3-58c8af32a529 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:22.881030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3f17811c-6c77-4236-81e3-58c8af32a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:22.891419 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15557a6c-facc-4722-afe2-d4bdb8a2a67a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:22.906347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7a0c-36ff-4b96-bf11-e5e2c59feed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:22.907190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7a0c-36ff-4b96-bf11-e5e2c59feed7 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:22.907655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7a0c-36ff-4b96-bf11-e5e2c59feed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:22.908071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff7a0c-36ff-4b96-bf11-e5e2c59feed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:22.923065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff7a0c-36ff-4b96-bf11-e5e2c59feed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:22.928248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff7a0c-36ff-4b96-bf11-e5e2c59feed7 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:22.952526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 833/1672] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:23.004266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17811c-6c77-4236-81e3-58c8af32a529 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:23.010600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:23.011671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:23.012081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:23.012467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] PATH_INFO: `/v3/projects/2fec538bf54949a9b9a1cf1ed60f1dd6` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:23.015281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fec538bf54949a9b9a1cf1ed60f1dd6)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:23.017437 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:23.100903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fec538bf54949a9b9a1cf1ed60f1dd6', 'request_id': 'req-a571a6a8-ec71-4728-a04a-870d94b63989'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.113095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fec538bf54949a9b9a1cf1ed60f1dd6', 'request_id': 'req-a571a6a8-ec71-4728-a04a-870d94b63989'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.121230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fec538bf54949a9b9a1cf1ed60f1dd6', 'request_id': 'req-a571a6a8-ec71-4728-a04a-870d94b63989'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.137928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] The token cache is being invalidate because project 2fec538bf54949a9b9a1cf1ed60f1dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:23.138445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.139485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.143252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 840/1673] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:22 2022] DELETE /identity/v3/projects/2fec538bf54949a9b9a1cf1ed60f1dd6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:23.146982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7a0c-36ff-4b96-bf11-e5e2c59feed7 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:23.164353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff7a0c-36ff-4b96-bf11-e5e2c59feed7 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:23.253716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:23.264943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:23.265229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:23.265530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] PATH_INFO: `/v3/users/a4a708a96d914473965561f196f1b1a4` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:23.269309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a708a96d914473965561f196f1b1a4)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:23.273021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:23.357252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a708a96d914473965561f196f1b1a4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.357965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a708a96d914473965561f196f1b1a4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.405534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a708a96d914473965561f196f1b1a4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.407139 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a708a96d914473965561f196f1b1a4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.421689 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a708a96d914473965561f196f1b1a4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.460493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 834/1674] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:23 2022] DELETE /identity/v3/users/a4a708a96d914473965561f196f1b1a4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:23.669244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:23.671270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:23.691430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:23.694429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:23.705950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a6a8-ec71-4728-a04a-870d94b63989 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:23.850335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:23.852014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:23.852475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:23.853111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] PATH_INFO: `/v3/projects/61c5391796034b64970131ad77213c3b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:23.854844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c5391796034b64970131ad77213c3b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:23.857577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:23.901427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa28b0-fdb4-4c9e-bd39-638c9fd0767b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:23.917578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:23.919368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:23.921131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:23.922917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] PATH_INFO: `/v3/projects/3be0839a5f6b49f5be6ae6adea94883b` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:23.929368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3be0839a5f6b49f5be6ae6adea94883b)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:23.932682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:23.973254 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c5391796034b64970131ad77213c3b', 'request_id': 'req-5159899b-0e01-4bf8-9e30-b34be495d270'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:23.992395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c5391796034b64970131ad77213c3b', 'request_id': 'req-5159899b-0e01-4bf8-9e30-b34be495d270'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.025413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c5391796034b64970131ad77213c3b', 'request_id': 'req-5159899b-0e01-4bf8-9e30-b34be495d270'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.053078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] The token cache is being invalidate because project 61c5391796034b64970131ad77213c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:24.053684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.054798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.058043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 841/1675] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:23 2022] DELETE /identity/v3/projects/61c5391796034b64970131ad77213c3b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:24.059427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:24.061182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:24.117029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3be0839a5f6b49f5be6ae6adea94883b', 'request_id': 'req-70d38483-be1e-4aeb-8287-d8f029f33f2a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.131928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3be0839a5f6b49f5be6ae6adea94883b', 'request_id': 'req-70d38483-be1e-4aeb-8287-d8f029f33f2a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.139461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3be0839a5f6b49f5be6ae6adea94883b', 'request_id': 'req-70d38483-be1e-4aeb-8287-d8f029f33f2a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.167642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] The token cache is being invalidate because project 3be0839a5f6b49f5be6ae6adea94883b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:24.167853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.169262 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70d38483-be1e-4aeb-8287-d8f029f33f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.174888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 835/1676] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:23 2022] DELETE /identity/v3/projects/3be0839a5f6b49f5be6ae6adea94883b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:24.179184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aedf3-0b86-44cd-8ca0-48cab0b7231a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:24.181552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aedf3-0b86-44cd-8ca0-48cab0b7231a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:24.182075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67aedf3-0b86-44cd-8ca0-48cab0b7231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:24.219404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-e67aedf3-0b86-44cd-8ca0-48cab0b7231a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:24.220757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e67aedf3-0b86-44cd-8ca0-48cab0b7231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:24.316087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159899b-0e01-4bf8-9e30-b34be495d270 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:24.378396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 836/1677] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:24.379867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6cc80-689e-49fe-9d82-1ec1c3c5d2df None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:24.380162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6cc80-689e-49fe-9d82-1ec1c3c5d2df None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:24.380442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6cc80-689e-49fe-9d82-1ec1c3c5d2df None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:24.382007 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 837/1678] 10.222.0.75 () {54 vars in 960 bytes} [Thu May 12 14:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:24.384590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826546e7-bf3b-469b-842d-f97b62cbb52c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:24.386231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826546e7-bf3b-469b-842d-f97b62cbb52c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:24.386519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826546e7-bf3b-469b-842d-f97b62cbb52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:24.452034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-826546e7-bf3b-469b-842d-f97b62cbb52c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:24.453264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-826546e7-bf3b-469b-842d-f97b62cbb52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:24.465990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:24.467091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:24.467388 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:24.467671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] PATH_INFO: `/v3/projects/af9b44c97df34eb988e8ea71233c037d` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:24.469171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9b44c97df34eb988e8ea71233c037d)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:24.471136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:24.491968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 838/1679] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:24.493570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c7d0d-aeba-427d-ad9b-65c896da1e95 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:24.493881 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c7d0d-aeba-427d-ad9b-65c896da1e95 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:24.495396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c7d0d-aeba-427d-ad9b-65c896da1e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:24.535637 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-eb2c7d0d-aeba-427d-ad9b-65c896da1e95 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:24.537425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-eb2c7d0d-aeba-427d-ad9b-65c896da1e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:24.561449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 839/1680] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:24.568237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d15acc-2498-438c-9584-f4251c3c3497 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:24.568556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d15acc-2498-438c-9584-f4251c3c3497 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:24.568816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d15acc-2498-438c-9584-f4251c3c3497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:24.586674 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9b44c97df34eb988e8ea71233c037d', 'request_id': 'req-c0454863-9a50-4d91-bd48-c8bc1e05ac72'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.608385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9b44c97df34eb988e8ea71233c037d', 'request_id': 'req-c0454863-9a50-4d91-bd48-c8bc1e05ac72'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.611511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-e8d15acc-2498-438c-9584-f4251c3c3497 None None] MFA Rules not processed for user `3004f3e4a9854502be59119e17e04961`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:24.615763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e8d15acc-2498-438c-9584-f4251c3c3497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:24.629429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9b44c97df34eb988e8ea71233c037d', 'request_id': 'req-c0454863-9a50-4d91-bd48-c8bc1e05ac72'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.656801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] The token cache is being invalidate because project af9b44c97df34eb988e8ea71233c037d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:24.657256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.658758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:24.661631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 842/1681] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:24 2022] DELETE /identity/v3/projects/af9b44c97df34eb988e8ea71233c037d => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:24.665025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:24.670972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:24.838029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 840/1682] 10.222.0.75 () {58 vars in 1057 bytes} [Thu May 12 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:24.841264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82410e-bbcd-4b72-aa57-5ee91541626c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:24.842454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82410e-bbcd-4b72-aa57-5ee91541626c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:24.843980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82410e-bbcd-4b72-aa57-5ee91541626c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:24.874413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0454863-9a50-4d91-bd48-c8bc1e05ac72 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:24.889124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-1e82410e-bbcd-4b72-aa57-5ee91541626c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:24.891813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1e82410e-bbcd-4b72-aa57-5ee91541626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:24.894960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:24.898008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:24.901034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:24.903225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] PATH_INFO: `/v3/projects/abc507c31e514b4bb6c962875caf9bdd` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:24.904853 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abc507c31e514b4bb6c962875caf9bdd)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:24.907421 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:24.924959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 841/1683] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:24.932503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82410e-bbcd-4b72-aa57-5ee91541626c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:24.937933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1e82410e-bbcd-4b72-aa57-5ee91541626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:24.969526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82410e-bbcd-4b72-aa57-5ee91541626c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:24.992015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abc507c31e514b4bb6c962875caf9bdd', 'request_id': 'req-93766269-4d83-4c89-814c-28bc1136c480'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:25.011573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abc507c31e514b4bb6c962875caf9bdd', 'request_id': 'req-93766269-4d83-4c89-814c-28bc1136c480'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:25.034068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abc507c31e514b4bb6c962875caf9bdd', 'request_id': 'req-93766269-4d83-4c89-814c-28bc1136c480'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:25.059305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] The token cache is being invalidate because project abc507c31e514b4bb6c962875caf9bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:25.061411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:25.062903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-93766269-4d83-4c89-814c-28bc1136c480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:25.066209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698486e2-b0e9-4807-9a29-c91e842b1ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:25.068172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698486e2-b0e9-4807-9a29-c91e842b1ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.071774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 843/1684] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:24 2022] DELETE /identity/v3/projects/abc507c31e514b4bb6c962875caf9bdd => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:25.074201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a8242-3e59-4443-ae3b-cce79df77d02 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.074908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698486e2-b0e9-4807-9a29-c91e842b1ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.075494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698486e2-b0e9-4807-9a29-c91e842b1ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.077013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698486e2-b0e9-4807-9a29-c91e842b1ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:25.077761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a8242-3e59-4443-ae3b-cce79df77d02 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.078231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a8242-3e59-4443-ae3b-cce79df77d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.080883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698486e2-b0e9-4807-9a29-c91e842b1ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:25.084285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698486e2-b0e9-4807-9a29-c91e842b1ea4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:25.126246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 842/1685] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:25.127795 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698486e2-b0e9-4807-9a29-c91e842b1ea4 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:25.130476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-698486e2-b0e9-4807-9a29-c91e842b1ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:25.133347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f99a8242-3e59-4443-ae3b-cce79df77d02 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:25.135701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f99a8242-3e59-4443-ae3b-cce79df77d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:25.158971 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 844/1686] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:25.161709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a8242-3e59-4443-ae3b-cce79df77d02 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:25.167458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f99a8242-3e59-4443-ae3b-cce79df77d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:25.188217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a8242-3e59-4443-ae3b-cce79df77d02 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:25.201952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3161ba1-3e5c-4347-be49-e28a4983b7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:25.207346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161ba1-3e5c-4347-be49-e28a4983b7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.208221 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161ba1-3e5c-4347-be49-e28a4983b7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.209322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3161ba1-3e5c-4347-be49-e28a4983b7f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.225329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161ba1-3e5c-4347-be49-e28a4983b7f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:25.226228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161ba1-3e5c-4347-be49-e28a4983b7f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:25.229326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3161ba1-3e5c-4347-be49-e28a4983b7f9 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:25.244716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 845/1687] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:25.250641 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c52f4f-f34f-49a7-b34f-9278dc31883f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.251141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c52f4f-f34f-49a7-b34f-9278dc31883f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.251547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c52f4f-f34f-49a7-b34f-9278dc31883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.276763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c8c52f4f-f34f-49a7-b34f-9278dc31883f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:25.277900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c8c52f4f-f34f-49a7-b34f-9278dc31883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:25.294549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698486e2-b0e9-4807-9a29-c91e842b1ea4 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:25.305097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 846/1688] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:25.306145 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c52f4f-f34f-49a7-b34f-9278dc31883f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:25.306570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ce5bf-5aec-4e19-8a2b-ff67ad135eab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3004f3e4a9854502be59119e17e04961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:25.307448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ce5bf-5aec-4e19-8a2b-ff67ad135eab service placement] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.307765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c8c52f4f-f34f-49a7-b34f-9278dc31883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:25.315252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ce5bf-5aec-4e19-8a2b-ff67ad135eab service placement] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.315807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ce5bf-5aec-4e19-8a2b-ff67ad135eab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.318634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8d9ce5bf-5aec-4e19-8a2b-ff67ad135eab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:25.321946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c52f4f-f34f-49a7-b34f-9278dc31883f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:25.327087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58951d8-f552-4236-8ee1-96aa3dbd1ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:25.327958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58951d8-f552-4236-8ee1-96aa3dbd1ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.328348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58951d8-f552-4236-8ee1-96aa3dbd1ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.328734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58951d8-f552-4236-8ee1-96aa3dbd1ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.329570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58951d8-f552-4236-8ee1-96aa3dbd1ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:25.331684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58951d8-f552-4236-8ee1-96aa3dbd1ff1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:25.350321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ce5bf-5aec-4e19-8a2b-ff67ad135eab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:25.352231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ce5bf-5aec-4e19-8a2b-ff67ad135eab service placement] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:25.375136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 847/1689] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:25 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:25.377301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46498beb-8560-47ff-8f25-c161a961f42a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.377753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46498beb-8560-47ff-8f25-c161a961f42a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.378511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46498beb-8560-47ff-8f25-c161a961f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.382760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 843/1690] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:25.383883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ce5bf-5aec-4e19-8a2b-ff67ad135eab service placement] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:25.413193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ce5bf-5aec-4e19-8a2b-ff67ad135eab service placement] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:25.420358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-46498beb-8560-47ff-8f25-c161a961f42a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:25.424349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-46498beb-8560-47ff-8f25-c161a961f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:25.611708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99110f4-1d31-4325-8f16-28523d0fa7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:25.612308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99110f4-1d31-4325-8f16-28523d0fa7be admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.612604 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99110f4-1d31-4325-8f16-28523d0fa7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.612885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99110f4-1d31-4325-8f16-28523d0fa7be admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.613600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99110f4-1d31-4325-8f16-28523d0fa7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:25.616161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 848/1691] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:25.618090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea7f6-4794-4d00-b45d-42a01bf0c087 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.618494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea7f6-4794-4d00-b45d-42a01bf0c087 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.619260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aea7f6-4794-4d00-b45d-42a01bf0c087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.623680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99110f4-1d31-4325-8f16-28523d0fa7be admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:25.653176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f0aea7f6-4794-4d00-b45d-42a01bf0c087 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:25.655457 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f0aea7f6-4794-4d00-b45d-42a01bf0c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:25.695237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 849/1692] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:25.696158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 844/1693] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:25 2022] POST /identity/v3/projects => generated 385 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:25.697041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99110f4-1d31-4325-8f16-28523d0fa7be admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:25.712166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aea7f6-4794-4d00-b45d-42a01bf0c087 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:25.738397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aea7f6-4794-4d00-b45d-42a01bf0c087 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:25.870703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99110f4-1d31-4325-8f16-28523d0fa7be admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:25.886815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664879-1793-4c95-931e-998427563013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:25.887731 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664879-1793-4c95-931e-998427563013 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.888701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664879-1793-4c95-931e-998427563013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.889146 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664879-1793-4c95-931e-998427563013 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.889386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818431d-fca7-497b-a184-f59bebd747e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:25.890080 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818431d-fca7-497b-a184-f59bebd747e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.890311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a664879-1793-4c95-931e-998427563013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:25.890414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818431d-fca7-497b-a184-f59bebd747e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.890633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818431d-fca7-497b-a184-f59bebd747e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.891656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818431d-fca7-497b-a184-f59bebd747e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:25.891969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818431d-fca7-497b-a184-f59bebd747e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:25.893097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a664879-1793-4c95-931e-998427563013 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:25.893603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818431d-fca7-497b-a184-f59bebd747e7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:25.924908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 845/1694] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:25.933077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 850/1695] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:25 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:25.934241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664879-1793-4c95-931e-998427563013 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:25.937068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818431d-fca7-497b-a184-f59bebd747e7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:25.952684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664879-1793-4c95-931e-998427563013 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:25.962992 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f8e44-2187-480d-aace-2691dd47b6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:25.966521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f8e44-2187-480d-aace-2691dd47b6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:25.967858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f8e44-2187-480d-aace-2691dd47b6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:25.968666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f8e44-2187-480d-aace-2691dd47b6f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:25.971557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f8e44-2187-480d-aace-2691dd47b6f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:25.974394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f8e44-2187-480d-aace-2691dd47b6f5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:25.998445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818431d-fca7-497b-a184-f59bebd747e7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.016493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe829e-f5a1-42a1-95ec-0d5f51b17db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.019016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe829e-f5a1-42a1-95ec-0d5f51b17db0 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.019629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe829e-f5a1-42a1-95ec-0d5f51b17db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.020150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe829e-f5a1-42a1-95ec-0d5f51b17db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.030858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe829e-f5a1-42a1-95ec-0d5f51b17db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:26.034565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe829e-f5a1-42a1-95ec-0d5f51b17db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.037070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe829e-f5a1-42a1-95ec-0d5f51b17db0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.056790 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 851/1696] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:25 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:26.056790 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f8e44-2187-480d-aace-2691dd47b6f5 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.073428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 846/1697] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:26.074959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe829e-f5a1-42a1-95ec-0d5f51b17db0 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.089263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe829e-f5a1-42a1-95ec-0d5f51b17db0 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.091799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f8e44-2187-480d-aace-2691dd47b6f5 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.101540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f4652-11d6-437d-b7b3-a5392435d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.102357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4652-11d6-437d-b7b3-a5392435d0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.102742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4652-11d6-437d-b7b3-a5392435d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.103331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f4652-11d6-437d-b7b3-a5392435d0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.104313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f4652-11d6-437d-b7b3-a5392435d0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.106307 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f4652-11d6-437d-b7b3-a5392435d0c6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.115989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27475b41-b6e5-46ae-a787-9e93c17efd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.119490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27475b41-b6e5-46ae-a787-9e93c17efd87 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.123368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27475b41-b6e5-46ae-a787-9e93c17efd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.123844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27475b41-b6e5-46ae-a787-9e93c17efd87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.124209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 847/1698] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:26.124899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27475b41-b6e5-46ae-a787-9e93c17efd87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.128830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f4652-11d6-437d-b7b3-a5392435d0c6 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.133737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27475b41-b6e5-46ae-a787-9e93c17efd87 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.170200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f4652-11d6-437d-b7b3-a5392435d0c6 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.188844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978705d7-f07d-4db5-9880-f6c0807d6907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.193466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978705d7-f07d-4db5-9880-f6c0807d6907 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.193805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978705d7-f07d-4db5-9880-f6c0807d6907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.194088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978705d7-f07d-4db5-9880-f6c0807d6907 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.194861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978705d7-f07d-4db5-9880-f6c0807d6907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.196793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978705d7-f07d-4db5-9880-f6c0807d6907 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.218569 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 848/1699] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:26.222657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978705d7-f07d-4db5-9880-f6c0807d6907 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.233952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 852/1700] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:26 2022] POST /identity/v3/projects => generated 369 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:26.234716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27475b41-b6e5-46ae-a787-9e93c17efd87 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.255633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978705d7-f07d-4db5-9880-f6c0807d6907 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.368004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b773e01-24e2-4ad0-9e0f-65f13b9834e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.369339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b773e01-24e2-4ad0-9e0f-65f13b9834e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.369339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b773e01-24e2-4ad0-9e0f-65f13b9834e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.369339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b773e01-24e2-4ad0-9e0f-65f13b9834e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.369941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b773e01-24e2-4ad0-9e0f-65f13b9834e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.371902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b773e01-24e2-4ad0-9e0f-65f13b9834e6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.375389 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27475b41-b6e5-46ae-a787-9e93c17efd87 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.383676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ed485-caa2-4253-baa5-64bf72cd81ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.384967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ed485-caa2-4253-baa5-64bf72cd81ec admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.385259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ed485-caa2-4253-baa5-64bf72cd81ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.385539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ed485-caa2-4253-baa5-64bf72cd81ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.387063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ed485-caa2-4253-baa5-64bf72cd81ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.389272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ed485-caa2-4253-baa5-64bf72cd81ec admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.412914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 853/1701] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:26.414924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ed485-caa2-4253-baa5-64bf72cd81ec admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.435585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 849/1702] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:26 2022] POST /identity/v3/projects => generated 357 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:26.438229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b773e01-24e2-4ad0-9e0f-65f13b9834e6 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.444647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ed485-caa2-4253-baa5-64bf72cd81ec admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.547409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b773e01-24e2-4ad0-9e0f-65f13b9834e6 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.552884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39caf5b-e995-4706-bde3-43a35e41dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.553569 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39caf5b-e995-4706-bde3-43a35e41dcd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.554017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39caf5b-e995-4706-bde3-43a35e41dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.554305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39caf5b-e995-4706-bde3-43a35e41dcd7 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.554995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39caf5b-e995-4706-bde3-43a35e41dcd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.556998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39caf5b-e995-4706-bde3-43a35e41dcd7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.563019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f7ee7-0853-4792-b18d-5845d356fe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.563742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f7ee7-0853-4792-b18d-5845d356fe0b admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.564028 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f7ee7-0853-4792-b18d-5845d356fe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.564305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f7ee7-0853-4792-b18d-5845d356fe0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.565040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f7ee7-0853-4792-b18d-5845d356fe0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.566715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f7ee7-0853-4792-b18d-5845d356fe0b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.580574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 854/1703] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:26.581613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f7ee7-0853-4792-b18d-5845d356fe0b admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.594427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 850/1704] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:26 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:26.595423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39caf5b-e995-4706-bde3-43a35e41dcd7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.595913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f7ee7-0853-4792-b18d-5845d356fe0b admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.606372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39caf5b-e995-4706-bde3-43a35e41dcd7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.606564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693b65a-7966-400b-b7f6-60641f7b5f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.607420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693b65a-7966-400b-b7f6-60641f7b5f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.607708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693b65a-7966-400b-b7f6-60641f7b5f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.607988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693b65a-7966-400b-b7f6-60641f7b5f17 admin admin] PATH_INFO: `/v3/projects/de2dbdf34db041e7bfb123aab506f44d/users/8598fc1c3131482cb8db4253d6a6aff2/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.612692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756360de-7aec-43ac-8122-7763cee6f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.613778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756360de-7aec-43ac-8122-7763cee6f19c admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.614805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756360de-7aec-43ac-8122-7763cee6f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.615628 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756360de-7aec-43ac-8122-7763cee6f19c admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.616483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756360de-7aec-43ac-8122-7763cee6f19c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.618594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756360de-7aec-43ac-8122-7763cee6f19c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.626103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693b65a-7966-400b-b7f6-60641f7b5f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2dbdf34db041e7bfb123aab506f44d, user_id=8598fc1c3131482cb8db4253d6a6aff2, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.629267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693b65a-7966-400b-b7f6-60641f7b5f17 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.640863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 851/1705] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:26 2022] POST /identity/v3/users => generated 279 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:26.642264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a9b86-98f9-4436-8b0a-f4aaf721fec0 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.642664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a9b86-98f9-4436-8b0a-f4aaf721fec0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.642949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a9b86-98f9-4436-8b0a-f4aaf721fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.647551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 855/1706] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:26 2022] PUT /identity/v3/projects/de2dbdf34db041e7bfb123aab506f44d/users/8598fc1c3131482cb8db4253d6a6aff2/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:26.649016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7f8a-0fb6-41a8-beb6-20cbfbdc72ab None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.649475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7f8a-0fb6-41a8-beb6-20cbfbdc72ab None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.649900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c7f8a-0fb6-41a8-beb6-20cbfbdc72ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.688723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-a05a9b86-98f9-4436-8b0a-f4aaf721fec0 None None] MFA Rules not processed for user `c3b76edcb338405a9bf2f68e91dfacdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:26.689906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a05a9b86-98f9-4436-8b0a-f4aaf721fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:26.709263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-bf1c7f8a-0fb6-41a8-beb6-20cbfbdc72ab None None] MFA Rules not processed for user `c6422873a3b84aac88f8a93291bcd7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:26.710517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-bf1c7f8a-0fb6-41a8-beb6-20cbfbdc72ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:26.763382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 852/1707] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:26.764296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a9b86-98f9-4436-8b0a-f4aaf721fec0 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.799578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 856/1708] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:26.800453 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c7f8a-0fb6-41a8-beb6-20cbfbdc72ab None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.910219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a9b86-98f9-4436-8b0a-f4aaf721fec0 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.926366 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f28964-6242-4bb6-a504-f821adc9f15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.928050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f28964-6242-4bb6-a504-f821adc9f15e admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.928331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f28964-6242-4bb6-a504-f821adc9f15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.928605 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f28964-6242-4bb6-a504-f821adc9f15e admin admin] PATH_INFO: `/v3/projects/1ecfb7b9e3d14711b14409f03c7367ee/users/32aa4ac28f454c36a375d4a174294ec4/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.940331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c7f8a-0fb6-41a8-beb6-20cbfbdc72ab None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:26.953975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0721ee-339c-4ce0-ac49-5a34037852d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:26.954738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0721ee-339c-4ce0-ac49-5a34037852d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:26.955041 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0721ee-339c-4ce0-ac49-5a34037852d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:26.955343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0721ee-339c-4ce0-ac49-5a34037852d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:26.956095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0721ee-339c-4ce0-ac49-5a34037852d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.959630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0721ee-339c-4ce0-ac49-5a34037852d5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.968159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f28964-6242-4bb6-a504-f821adc9f15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ecfb7b9e3d14711b14409f03c7367ee, user_id=32aa4ac28f454c36a375d4a174294ec4, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:26.978699 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f28964-6242-4bb6-a504-f821adc9f15e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:26.983666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 857/1709] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:26.988253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0721ee-339c-4ce0-ac49-5a34037852d5 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:26.998407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 853/1710] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:26 2022] PUT /identity/v3/projects/1ecfb7b9e3d14711b14409f03c7367ee/users/32aa4ac28f454c36a375d4a174294ec4/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:27.001359 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136851e6-6d1a-4067-a394-01f798dfe4b6 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:27.002072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136851e6-6d1a-4067-a394-01f798dfe4b6 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:27.002570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136851e6-6d1a-4067-a394-01f798dfe4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:27.034787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0721ee-339c-4ce0-ac49-5a34037852d5 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:27.036760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-136851e6-6d1a-4067-a394-01f798dfe4b6 None None] MFA Rules not processed for user `8598fc1c3131482cb8db4253d6a6aff2`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:27.038337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-136851e6-6d1a-4067-a394-01f798dfe4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:27.135655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 854/1711] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:27.139166 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136851e6-6d1a-4067-a394-01f798dfe4b6 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:27.147408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-136851e6-6d1a-4067-a394-01f798dfe4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:27.184517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd86ee-576a-4d6a-9924-ea64b44d2682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:27.185215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd86ee-576a-4d6a-9924-ea64b44d2682 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:27.185494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd86ee-576a-4d6a-9924-ea64b44d2682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:27.185771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd86ee-576a-4d6a-9924-ea64b44d2682 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:27.195387 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd86ee-576a-4d6a-9924-ea64b44d2682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:27.197064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd86ee-576a-4d6a-9924-ea64b44d2682 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:27.216584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 858/1712] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:27.220629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd86ee-576a-4d6a-9924-ea64b44d2682 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:27.239508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd86ee-576a-4d6a-9924-ea64b44d2682 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:27.250528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fe153-d250-44fb-8894-d6224763ea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:27.251609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fe153-d250-44fb-8894-d6224763ea57 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:27.252014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fe153-d250-44fb-8894-d6224763ea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:27.256875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fe153-d250-44fb-8894-d6224763ea57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:27.258091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fe153-d250-44fb-8894-d6224763ea57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:27.259934 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fe153-d250-44fb-8894-d6224763ea57 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:27.279562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 859/1713] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:27.283199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14f551-0ebf-4dc9-ad92-4ccc7a48900c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:27.283721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14f551-0ebf-4dc9-ad92-4ccc7a48900c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:27.284720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14f551-0ebf-4dc9-ad92-4ccc7a48900c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:27.295727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136851e6-6d1a-4067-a394-01f798dfe4b6 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:27.304055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f5245-65fd-4858-b03f-f51d4ff37e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:27.305381 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f5245-65fd-4858-b03f-f51d4ff37e91 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:27.305973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f5245-65fd-4858-b03f-f51d4ff37e91 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:27.306529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f5245-65fd-4858-b03f-f51d4ff37e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:27.372341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-8e14f551-0ebf-4dc9-ad92-4ccc7a48900c None None] MFA Rules not processed for user `32aa4ac28f454c36a375d4a174294ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:27.374126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8e14f551-0ebf-4dc9-ad92-4ccc7a48900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:27.412348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f5245-65fd-4858-b03f-f51d4ff37e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:27.414048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f5245-65fd-4858-b03f-f51d4ff37e91 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:27.434989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 855/1714] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:27.436770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f5245-65fd-4858-b03f-f51d4ff37e91 service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:27.463548 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f5245-65fd-4858-b03f-f51d4ff37e91 service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:27.478673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983109c-ec27-4e5d-be13-43119f456ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:27.479532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983109c-ec27-4e5d-be13-43119f456ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:27.479936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983109c-ec27-4e5d-be13-43119f456ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:27.480319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983109c-ec27-4e5d-be13-43119f456ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:27.481132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983109c-ec27-4e5d-be13-43119f456ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:27.483197 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983109c-ec27-4e5d-be13-43119f456ab3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:27.512729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 860/1715] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:27.515436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14f551-0ebf-4dc9-ad92-4ccc7a48900c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:27.517833 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8e14f551-0ebf-4dc9-ad92-4ccc7a48900c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:27.549373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 856/1716] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:27 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:27.550428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983109c-ec27-4e5d-be13-43119f456ab3 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:27.565719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14f551-0ebf-4dc9-ad92-4ccc7a48900c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:27.685146 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01998e98-be69-4f6e-ae24-b0b321219704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:27.685828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01998e98-be69-4f6e-ae24-b0b321219704 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:27.686163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01998e98-be69-4f6e-ae24-b0b321219704 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:27.686452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01998e98-be69-4f6e-ae24-b0b321219704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:27.719736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983109c-ec27-4e5d-be13-43119f456ab3 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:27.725209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8ad1-ed7b-49a3-9d5b-77459e9e2e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:27.725896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8ad1-ed7b-49a3-9d5b-77459e9e2e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:27.726180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8ad1-ed7b-49a3-9d5b-77459e9e2e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:27.726456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec8ad1-ed7b-49a3-9d5b-77459e9e2e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:27.727292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8ad1-ed7b-49a3-9d5b-77459e9e2e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:27.729816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec8ad1-ed7b-49a3-9d5b-77459e9e2e54 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:27.740327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 857/1717] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:27.744580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8ad1-ed7b-49a3-9d5b-77459e9e2e54 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:27.760215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec8ad1-ed7b-49a3-9d5b-77459e9e2e54 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:27.770970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01998e98-be69-4f6e-ae24-b0b321219704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:27.772789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01998e98-be69-4f6e-ae24-b0b321219704 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:27.773998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3bf53-cc40-4b61-8040-895aa0433fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:27.776519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3bf53-cc40-4b61-8040-895aa0433fad admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:27.776826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3bf53-cc40-4b61-8040-895aa0433fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:27.779314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3bf53-cc40-4b61-8040-895aa0433fad admin admin] PATH_INFO: `/v3/projects/63f89b9869c542499a423a75997976f9/users/bca2b91e85a4406e8dec4c995b67cc37/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:27.785183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 861/1718] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:27.786082 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01998e98-be69-4f6e-ae24-b0b321219704 service nova] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:27.799068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01998e98-be69-4f6e-ae24-b0b321219704 service nova] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:27.805118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3465cb-0b84-4201-a11d-dd2cd62fbc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:27.805800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3465cb-0b84-4201-a11d-dd2cd62fbc95 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:27.806087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3465cb-0b84-4201-a11d-dd2cd62fbc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:27.806367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3465cb-0b84-4201-a11d-dd2cd62fbc95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:27.809763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3465cb-0b84-4201-a11d-dd2cd62fbc95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:27.815757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3465cb-0b84-4201-a11d-dd2cd62fbc95 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:27.815872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3bf53-cc40-4b61-8040-895aa0433fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f89b9869c542499a423a75997976f9, user_id=bca2b91e85a4406e8dec4c995b67cc37, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:27.819480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3bf53-cc40-4b61-8040-895aa0433fad admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:27.848233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 858/1719] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:27 2022] PUT /identity/v3/projects/63f89b9869c542499a423a75997976f9/users/bca2b91e85a4406e8dec4c995b67cc37/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:27.849270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3bf53-cc40-4b61-8040-895aa0433fad admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:27.858353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 862/1720] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:27 2022] POST /identity/v3/projects => generated 387 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:27.859588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3465cb-0b84-4201-a11d-dd2cd62fbc95 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:27.986583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3465cb-0b84-4201-a11d-dd2cd62fbc95 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:27.995629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3bf53-cc40-4b61-8040-895aa0433fad admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:28.003163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bf0b3-3729-4e6b-a880-de98669a9b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:28.004315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21782b51-7059-498f-a42a-97be356bbfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:28.005324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bf0b3-3729-4e6b-a880-de98669a9b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.006707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21782b51-7059-498f-a42a-97be356bbfeb admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.006839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bf0b3-3729-4e6b-a880-de98669a9b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.007422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bf0b3-3729-4e6b-a880-de98669a9b2e admin admin] PATH_INFO: `/v3/projects/775a098c7d7d48739a1e9efa3a4c884a/users/83842267ac924e4487dd6c7e4eca553c/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.007717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21782b51-7059-498f-a42a-97be356bbfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.008161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21782b51-7059-498f-a42a-97be356bbfeb admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.009528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21782b51-7059-498f-a42a-97be356bbfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:28.012189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21782b51-7059-498f-a42a-97be356bbfeb admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:28.045552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 859/1721] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:27 2022] POST /identity/v3/users => generated 295 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:28.048437 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bd27-e1bb-4363-9def-d891a6a4dab7 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.049329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bd27-e1bb-4363-9def-d891a6a4dab7 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.049639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7bd27-e1bb-4363-9def-d891a6a4dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.054421 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bf0b3-3729-4e6b-a880-de98669a9b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=775a098c7d7d48739a1e9efa3a4c884a, user_id=83842267ac924e4487dd6c7e4eca553c, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:28.057322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60bf0b3-3729-4e6b-a880-de98669a9b2e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:28.087572 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 863/1722] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:27 2022] PUT /identity/v3/projects/775a098c7d7d48739a1e9efa3a4c884a/users/83842267ac924e4487dd6c7e4eca553c/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:28.088519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bf0b3-3729-4e6b-a880-de98669a9b2e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:28.101986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-52b7bd27-e1bb-4363-9def-d891a6a4dab7 None None] MFA Rules not processed for user `bca2b91e85a4406e8dec4c995b67cc37`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:28.103891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-52b7bd27-e1bb-4363-9def-d891a6a4dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:28.227178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 860/1723] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:28.228304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7bd27-e1bb-4363-9def-d891a6a4dab7 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:28.302525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bf0b3-3729-4e6b-a880-de98669a9b2e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:28.312583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9965d6-7542-42dc-b070-04d4f9d2cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:28.313695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9965d6-7542-42dc-b070-04d4f9d2cd13 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.315385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9965d6-7542-42dc-b070-04d4f9d2cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.318150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9965d6-7542-42dc-b070-04d4f9d2cd13 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.319494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9965d6-7542-42dc-b070-04d4f9d2cd13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:28.324427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9965d6-7542-42dc-b070-04d4f9d2cd13 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:28.334602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7bd27-e1bb-4363-9def-d891a6a4dab7 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:28.349788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ebb1-93cb-4bfa-b502-ccfa2b285a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:28.351942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ebb1-93cb-4bfa-b502-ccfa2b285a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.351942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ebb1-93cb-4bfa-b502-ccfa2b285a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.353452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ebb1-93cb-4bfa-b502-ccfa2b285a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.357014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9ebb1-93cb-4bfa-b502-ccfa2b285a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:28.361636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9ebb1-93cb-4bfa-b502-ccfa2b285a7a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:28.387731 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 864/1724] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:28 2022] POST /identity/v3/users => generated 300 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:28.389673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c8d4f-3deb-44af-9ce4-038ac00c93e6 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.389977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c8d4f-3deb-44af-9ce4-038ac00c93e6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.390277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c8d4f-3deb-44af-9ce4-038ac00c93e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.402428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 861/1725] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:28.411263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ebb1-93cb-4bfa-b502-ccfa2b285a7a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:28.432941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-eb5c8d4f-3deb-44af-9ce4-038ac00c93e6 None None] MFA Rules not processed for user `83842267ac924e4487dd6c7e4eca553c`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:28.434246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-eb5c8d4f-3deb-44af-9ce4-038ac00c93e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:28.445474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ebb1-93cb-4bfa-b502-ccfa2b285a7a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:28.451502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf2aa3-86a9-4e99-bdf9-86228f5d1f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:28.452167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf2aa3-86a9-4e99-bdf9-86228f5d1f53 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.452446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf2aa3-86a9-4e99-bdf9-86228f5d1f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.452723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf2aa3-86a9-4e99-bdf9-86228f5d1f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.453423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf2aa3-86a9-4e99-bdf9-86228f5d1f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:28.461256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf2aa3-86a9-4e99-bdf9-86228f5d1f53 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:28.522636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 862/1726] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:28 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:28.523801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf2aa3-86a9-4e99-bdf9-86228f5d1f53 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:28.628817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 865/1727] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:28.628817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c8d4f-3deb-44af-9ce4-038ac00c93e6 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:28.649139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c8d4f-3deb-44af-9ce4-038ac00c93e6 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:28.675971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf2aa3-86a9-4e99-bdf9-86228f5d1f53 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:28.706368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8314c-0868-4ed6-8b3e-bf78dc536583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:28.707255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8314c-0868-4ed6-8b3e-bf78dc536583 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.707740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8314c-0868-4ed6-8b3e-bf78dc536583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.708165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8314c-0868-4ed6-8b3e-bf78dc536583 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.709082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8314c-0868-4ed6-8b3e-bf78dc536583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:28.710870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8314c-0868-4ed6-8b3e-bf78dc536583 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:28.754314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 863/1728] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:28.756057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8314c-0868-4ed6-8b3e-bf78dc536583 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:28.778086 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8314c-0868-4ed6-8b3e-bf78dc536583 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:28.784330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b24c86-e4b6-4598-92df-efbe28ad02f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:28.785348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24c86-e4b6-4598-92df-efbe28ad02f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.786587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24c86-e4b6-4598-92df-efbe28ad02f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.787674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b24c86-e4b6-4598-92df-efbe28ad02f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.788877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b24c86-e4b6-4598-92df-efbe28ad02f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:28.791443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b24c86-e4b6-4598-92df-efbe28ad02f1 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:28.813230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d850-2eb5-43e4-899f-1689a5895a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:28.814676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d850-2eb5-43e4-899f-1689a5895a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.819704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d850-2eb5-43e4-899f-1689a5895a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.820166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d850-2eb5-43e4-899f-1689a5895a78 admin admin] PATH_INFO: `/v3/projects/5815d1d9ed6f41c68b019e37eea187ef/users/93e09989f54742e584ecba30b6e94048/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.831965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 864/1729] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:28 2022] POST /identity/v3/users => generated 290 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:28.834572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b24c86-e4b6-4598-92df-efbe28ad02f1 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:28.859125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160d850-2eb5-43e4-899f-1689a5895a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5815d1d9ed6f41c68b019e37eea187ef, user_id=93e09989f54742e584ecba30b6e94048, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:28.863482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b24c86-e4b6-4598-92df-efbe28ad02f1 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:28.873056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160d850-2eb5-43e4-899f-1689a5895a78 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:28.880660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b981b-2c2d-40d4-a7d7-a67fcba626ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:28.881652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b981b-2c2d-40d4-a7d7-a67fcba626ea admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.882519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b981b-2c2d-40d4-a7d7-a67fcba626ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.883188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b981b-2c2d-40d4-a7d7-a67fcba626ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:28.884199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b981b-2c2d-40d4-a7d7-a67fcba626ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:28.886429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b981b-2c2d-40d4-a7d7-a67fcba626ea admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:28.936344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 866/1730] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:28 2022] PUT /identity/v3/projects/5815d1d9ed6f41c68b019e37eea187ef/users/93e09989f54742e584ecba30b6e94048/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:28.937647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d850-2eb5-43e4-899f-1689a5895a78 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:28.982436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 865/1731] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:28 2022] POST /identity/v3/projects => generated 357 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:28.987457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff8fb-c5de-46be-9886-03b2db2b35fd None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:28.995110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff8fb-c5de-46be-9886-03b2db2b35fd None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:28.995554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff8fb-c5de-46be-9886-03b2db2b35fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:29.054064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b95ff8fb-c5de-46be-9886-03b2db2b35fd None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:29.056960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b95ff8fb-c5de-46be-9886-03b2db2b35fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:29.091760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d850-2eb5-43e4-899f-1689a5895a78 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:29.215915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 866/1732] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:29.216888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff8fb-c5de-46be-9886-03b2db2b35fd None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:29.230763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0face5e1-f618-49ea-8e4e-48b602699aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:29.232111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0face5e1-f618-49ea-8e4e-48b602699aec admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:29.232548 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0face5e1-f618-49ea-8e4e-48b602699aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:29.233147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0face5e1-f618-49ea-8e4e-48b602699aec admin admin] PATH_INFO: `/v3/projects/8b0997e5ef524b869aab4174a7030165/users/6d484bfcad9d452ea706f5f1ab11135a/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:29.254903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff8fb-c5de-46be-9886-03b2db2b35fd None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:29.264195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0face5e1-f618-49ea-8e4e-48b602699aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0997e5ef524b869aab4174a7030165, user_id=6d484bfcad9d452ea706f5f1ab11135a, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:29.268896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da643890-d236-4565-a501-d7ae793bc1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:29.269202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0face5e1-f618-49ea-8e4e-48b602699aec admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:29.269592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da643890-d236-4565-a501-d7ae793bc1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:29.269877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da643890-d236-4565-a501-d7ae793bc1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:29.270707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da643890-d236-4565-a501-d7ae793bc1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:29.271708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da643890-d236-4565-a501-d7ae793bc1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:29.274676 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da643890-d236-4565-a501-d7ae793bc1b9 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:29.292579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 867/1733] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:28 2022] PUT /identity/v3/projects/8b0997e5ef524b869aab4174a7030165/users/6d484bfcad9d452ea706f5f1ab11135a/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:29.294216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0face5e1-f618-49ea-8e4e-48b602699aec admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:29.320442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 867/1734] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:29.322312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da643890-d236-4565-a501-d7ae793bc1b9 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:29.333702 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da643890-d236-4565-a501-d7ae793bc1b9 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:29.453325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0face5e1-f618-49ea-8e4e-48b602699aec admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:29.485942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7687aa-8b39-4aad-9139-36510beec116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:29.486158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670bea6-b1f5-4b01-b786-ab2674f9f7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:29.487922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670bea6-b1f5-4b01-b786-ab2674f9f7da admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:29.488372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670bea6-b1f5-4b01-b786-ab2674f9f7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:29.488807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670bea6-b1f5-4b01-b786-ab2674f9f7da admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:29.489914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670bea6-b1f5-4b01-b786-ab2674f9f7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:29.490612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7687aa-8b39-4aad-9139-36510beec116 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:29.491055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7687aa-8b39-4aad-9139-36510beec116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:29.493208 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8670bea6-b1f5-4b01-b786-ab2674f9f7da admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:29.493660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7687aa-8b39-4aad-9139-36510beec116 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:29.494708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7687aa-8b39-4aad-9139-36510beec116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:29.499722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7687aa-8b39-4aad-9139-36510beec116 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:29.535119 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 868/1735] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:29.539199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7687aa-8b39-4aad-9139-36510beec116 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:29.539642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 868/1736] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:29 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:29.540840 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670bea6-b1f5-4b01-b786-ab2674f9f7da admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:29.553790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670bea6-b1f5-4b01-b786-ab2674f9f7da admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:29.560286 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd48d21-dbfc-494b-aefc-3a8a4823cffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:29.561438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd48d21-dbfc-494b-aefc-3a8a4823cffa admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:29.561846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd48d21-dbfc-494b-aefc-3a8a4823cffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:29.562280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd48d21-dbfc-494b-aefc-3a8a4823cffa admin admin] PATH_INFO: `/v3/projects/1d52cd3e9725476eb826b68f1026bc52/users/3c323223819c432d8478e4849adf1d9b/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:29.566086 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7687aa-8b39-4aad-9139-36510beec116 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:29.580897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c2d99-2dd9-4719-b444-d9b2523ba06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:29.582012 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd48d21-dbfc-494b-aefc-3a8a4823cffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d52cd3e9725476eb826b68f1026bc52, user_id=3c323223819c432d8478e4849adf1d9b, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:29.583590 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c2d99-2dd9-4719-b444-d9b2523ba06e admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:29.588123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c2d99-2dd9-4719-b444-d9b2523ba06e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:29.588941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c2d99-2dd9-4719-b444-d9b2523ba06e admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:29.590699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c2d99-2dd9-4719-b444-d9b2523ba06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:29.593716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c2d99-2dd9-4719-b444-d9b2523ba06e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:29.600797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd48d21-dbfc-494b-aefc-3a8a4823cffa admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:29.620591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 869/1737] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:29.627404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 869/1738] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:29 2022] PUT /identity/v3/projects/1d52cd3e9725476eb826b68f1026bc52/users/3c323223819c432d8478e4849adf1d9b/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:29.630033 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd48d21-dbfc-494b-aefc-3a8a4823cffa admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:29.637238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c2d99-2dd9-4719-b444-d9b2523ba06e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:29.639299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-664c2d99-2dd9-4719-b444-d9b2523ba06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:29.826908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd48d21-dbfc-494b-aefc-3a8a4823cffa admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:29.829235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c2d99-2dd9-4719-b444-d9b2523ba06e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:29.846005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47efc97-7dce-4fc9-b25b-f7eb922f91c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:29.846997 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47efc97-7dce-4fc9-b25b-f7eb922f91c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:29.847546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47efc97-7dce-4fc9-b25b-f7eb922f91c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:29.848061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47efc97-7dce-4fc9-b25b-f7eb922f91c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:29.849587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47efc97-7dce-4fc9-b25b-f7eb922f91c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:29.851477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47efc97-7dce-4fc9-b25b-f7eb922f91c9 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:29.867285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 870/1739] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:29.867285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47efc97-7dce-4fc9-b25b-f7eb922f91c9 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:29.889204 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47efc97-7dce-4fc9-b25b-f7eb922f91c9 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:29.903483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7de246-7b57-456a-af30-4fffe447ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:29.904681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7de246-7b57-456a-af30-4fffe447ab4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:29.904966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7de246-7b57-456a-af30-4fffe447ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:29.905247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7de246-7b57-456a-af30-4fffe447ab4e admin admin] PATH_INFO: `/v3/projects/5815d1d9ed6f41c68b019e37eea187ef/users/93e09989f54742e584ecba30b6e94048/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:29.909028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7de246-7b57-456a-af30-4fffe447ab4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5815d1d9ed6f41c68b019e37eea187ef, user_id=93e09989f54742e584ecba30b6e94048, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:29.917976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7de246-7b57-456a-af30-4fffe447ab4e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:29.951343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fae296-7cdd-45a7-ba7a-948562dddffa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:29.952033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae296-7cdd-45a7-ba7a-948562dddffa service swift] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:29.952462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae296-7cdd-45a7-ba7a-948562dddffa service swift] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:29.952754 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fae296-7cdd-45a7-ba7a-948562dddffa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:29.956039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 871/1740] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:29 2022] PUT /identity/v3/projects/5815d1d9ed6f41c68b019e37eea187ef/users/93e09989f54742e584ecba30b6e94048/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:29.957057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7de246-7b57-456a-af30-4fffe447ab4e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:30.078832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fae296-7cdd-45a7-ba7a-948562dddffa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:30.080707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fae296-7cdd-45a7-ba7a-948562dddffa service swift] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:30.109185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7de246-7b57-456a-af30-4fffe447ab4e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:30.109866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 870/1741] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:31:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:31:30.110694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe584b-87a0-40d6-b1f0-a932315d0565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:30.110822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fae296-7cdd-45a7-ba7a-948562dddffa service swift] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:30.112262 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe584b-87a0-40d6-b1f0-a932315d0565 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:30.112642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe584b-87a0-40d6-b1f0-a932315d0565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:30.112927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe584b-87a0-40d6-b1f0-a932315d0565 admin admin] PATH_INFO: `/v3/projects/8b0997e5ef524b869aab4174a7030165/users/6d484bfcad9d452ea706f5f1ab11135a/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:30.115499 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe584b-87a0-40d6-b1f0-a932315d0565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0997e5ef524b869aab4174a7030165, user_id=6d484bfcad9d452ea706f5f1ab11135a, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:30.118673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe584b-87a0-40d6-b1f0-a932315d0565 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:30.135085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 872/1742] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:29 2022] PUT /identity/v3/projects/8b0997e5ef524b869aab4174a7030165/users/6d484bfcad9d452ea706f5f1ab11135a/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:30.136801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe584b-87a0-40d6-b1f0-a932315d0565 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:30.152914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fae296-7cdd-45a7-ba7a-948562dddffa service swift] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:30.406990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70eca3-c485-4212-9cf8-87ebe4d8e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:30.411437 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70eca3-c485-4212-9cf8-87ebe4d8e6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:30.411782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70eca3-c485-4212-9cf8-87ebe4d8e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:30.412242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70eca3-c485-4212-9cf8-87ebe4d8e6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:30.414576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70eca3-c485-4212-9cf8-87ebe4d8e6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:30.420155 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70eca3-c485-4212-9cf8-87ebe4d8e6ca admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:30.475178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 871/1743] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:30.479472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3dc2-5453-4c5b-9caa-02d59dfed857 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:30.479854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3dc2-5453-4c5b-9caa-02d59dfed857 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:30.480155 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3dc2-5453-4c5b-9caa-02d59dfed857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:30.540595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe584b-87a0-40d6-b1f0-a932315d0565 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:30.557319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-647d3dc2-5453-4c5b-9caa-02d59dfed857 None None] MFA Rules not processed for user `93e09989f54742e584ecba30b6e94048`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:30.561519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc52c-7438-4399-b5ce-25b395848db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:30.561945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-647d3dc2-5453-4c5b-9caa-02d59dfed857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:30.562981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc52c-7438-4399-b5ce-25b395848db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:30.563529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc52c-7438-4399-b5ce-25b395848db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:30.563970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc52c-7438-4399-b5ce-25b395848db3 admin admin] PATH_INFO: `/v3/projects/3750b6b6dafa496b82164e20da11fe2f/users/23b5a21b71b14b7f930daa3d63b20f42/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:30.629416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cc52c-7438-4399-b5ce-25b395848db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3750b6b6dafa496b82164e20da11fe2f, user_id=23b5a21b71b14b7f930daa3d63b20f42, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:30.637068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cc52c-7438-4399-b5ce-25b395848db3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:30.679715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 873/1744] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:30 2022] PUT /identity/v3/projects/3750b6b6dafa496b82164e20da11fe2f/users/23b5a21b71b14b7f930daa3d63b20f42/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:30.679715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7849b-b157-41f9-a2cd-b1455c4b2c87 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:30.679715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7849b-b157-41f9-a2cd-b1455c4b2c87 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:30.679715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7849b-b157-41f9-a2cd-b1455c4b2c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:30.777823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-90c7849b-b157-41f9-a2cd-b1455c4b2c87 None None] MFA Rules not processed for user `6d484bfcad9d452ea706f5f1ab11135a`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:30.779494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-90c7849b-b157-41f9-a2cd-b1455c4b2c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:30.804213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 872/1745] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:30.806280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d3dc2-5453-4c5b-9caa-02d59dfed857 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:30.811196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-647d3dc2-5453-4c5b-9caa-02d59dfed857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:30.869671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d3dc2-5453-4c5b-9caa-02d59dfed857 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:30.974412 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 874/1746] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:30.976065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7849b-b157-41f9-a2cd-b1455c4b2c87 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:31.040238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:31.041118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:31.041408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:31.041680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] PATH_INFO: `/v3/users/03d540e2706a4c3491629f6b8fc40ff9` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:31.043383 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d540e2706a4c3491629f6b8fc40ff9)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:31.045130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:31.167015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d540e2706a4c3491629f6b8fc40ff9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:31.178769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d540e2706a4c3491629f6b8fc40ff9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:31.184569 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d540e2706a4c3491629f6b8fc40ff9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:31.187469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d540e2706a4c3491629f6b8fc40ff9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:31.202390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7849b-b157-41f9-a2cd-b1455c4b2c87 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:31.208015 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa13548-23d3-421a-a464-34c9de26b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:31.209071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa13548-23d3-421a-a464-34c9de26b8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:31.209448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa13548-23d3-421a-a464-34c9de26b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:31.209831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa13548-23d3-421a-a464-34c9de26b8b9 admin admin] PATH_INFO: `/v3/projects/1d52cd3e9725476eb826b68f1026bc52/users/3c323223819c432d8478e4849adf1d9b/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:31.210293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d540e2706a4c3491629f6b8fc40ff9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:31.212372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa13548-23d3-421a-a464-34c9de26b8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d52cd3e9725476eb826b68f1026bc52, user_id=3c323223819c432d8478e4849adf1d9b, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:31.215683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa13548-23d3-421a-a464-34c9de26b8b9 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:31.236180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 875/1747] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:30 2022] PUT /identity/v3/projects/1d52cd3e9725476eb826b68f1026bc52/users/3c323223819c432d8478e4849adf1d9b/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:31.237331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa13548-23d3-421a-a464-34c9de26b8b9 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:31.258457 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 873/1748] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:30 2022] DELETE /identity/v3/users/03d540e2706a4c3491629f6b8fc40ff9 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:31.259964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:31.263262 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-aaa13548-23d3-421a-a464-34c9de26b8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:31.264884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:31.462175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35c4b1-2f5e-4a72-9e80-b95a0250a647 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:31.478525 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa13548-23d3-421a-a464-34c9de26b8b9 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:31.490813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c399fa-1cc3-4d20-9962-cb5d3e0d5544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:31.491728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c399fa-1cc3-4d20-9962-cb5d3e0d5544 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:31.492015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c399fa-1cc3-4d20-9962-cb5d3e0d5544 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:31.492430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c399fa-1cc3-4d20-9962-cb5d3e0d5544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:31.496591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-55c399fa-1cc3-4d20-9962-cb5d3e0d5544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:31.616781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba33b-dcc1-4bd1-8be2-c03e2230725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:31.617488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba33b-dcc1-4bd1-8be2-c03e2230725f admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:31.617829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba33b-dcc1-4bd1-8be2-c03e2230725f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:31.618119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba33b-dcc1-4bd1-8be2-c03e2230725f admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:31.618867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba33b-dcc1-4bd1-8be2-c03e2230725f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:31.625504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ba33b-dcc1-4bd1-8be2-c03e2230725f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:31.664174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 876/1749] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:31.665626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba33b-dcc1-4bd1-8be2-c03e2230725f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:31.669178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-372ba33b-dcc1-4bd1-8be2-c03e2230725f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:31.701598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ba33b-dcc1-4bd1-8be2-c03e2230725f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:31.704714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c399fa-1cc3-4d20-9962-cb5d3e0d5544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:31.711323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069da0d-43a9-40e1-abed-3a535b194fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:31.712260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c399fa-1cc3-4d20-9962-cb5d3e0d5544 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:31.712745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069da0d-43a9-40e1-abed-3a535b194fca service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:31.713192 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069da0d-43a9-40e1-abed-3a535b194fca service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:31.715147 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069da0d-43a9-40e1-abed-3a535b194fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:31.724700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f069da0d-43a9-40e1-abed-3a535b194fca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:31.809484 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 874/1750] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:31.812182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1efd85-06e8-4a27-81cb-84c271100677 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:31.815424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1efd85-06e8-4a27-81cb-84c271100677 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:31.816865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1efd85-06e8-4a27-81cb-84c271100677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:31.882910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-0b1efd85-06e8-4a27-81cb-84c271100677 None None] MFA Rules not processed for user `5aca248c2e074fc4baff39930e21fe29`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:31.886988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0b1efd85-06e8-4a27-81cb-84c271100677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:31.888281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069da0d-43a9-40e1-abed-3a535b194fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:31.889993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f069da0d-43a9-40e1-abed-3a535b194fca service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:31.909836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 877/1751] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:31.928271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d322be-0723-4e71-9548-a407bacd7960 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:31.928590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d322be-0723-4e71-9548-a407bacd7960 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:31.928853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d322be-0723-4e71-9548-a407bacd7960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:31.972643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 875/1752] 10.222.0.57 () {58 vars in 1015 bytes} [Thu May 12 14:31:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:31.974198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73615ee-a305-4d0a-a902-e103704b2c48 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:31.982029 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73615ee-a305-4d0a-a902-e103704b2c48 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:31.982654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73615ee-a305-4d0a-a902-e103704b2c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:31.999647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-53d322be-0723-4e71-9548-a407bacd7960 None None] MFA Rules not processed for user `3c323223819c432d8478e4849adf1d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:32.001992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-53d322be-0723-4e71-9548-a407bacd7960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:32.019738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f73615ee-a305-4d0a-a902-e103704b2c48 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:32.021583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f73615ee-a305-4d0a-a902-e103704b2c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:32.040603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 876/1753] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:32.041478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73615ee-a305-4d0a-a902-e103704b2c48 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:32.059668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73615ee-a305-4d0a-a902-e103704b2c48 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:32.069528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3003e1-4be0-4e33-b3a8-051a7bc240a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:32.072033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3003e1-4be0-4e33-b3a8-051a7bc240a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:32.073331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3003e1-4be0-4e33-b3a8-051a7bc240a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:32.074714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3003e1-4be0-4e33-b3a8-051a7bc240a3 admin admin] PATH_INFO: `/v3/projects/3750b6b6dafa496b82164e20da11fe2f/users/23b5a21b71b14b7f930daa3d63b20f42/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:32.078353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3003e1-4be0-4e33-b3a8-051a7bc240a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3750b6b6dafa496b82164e20da11fe2f, user_id=23b5a21b71b14b7f930daa3d63b20f42, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:32.080936 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3003e1-4be0-4e33-b3a8-051a7bc240a3 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:32.116843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 877/1754] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:32 2022] PUT /identity/v3/projects/3750b6b6dafa496b82164e20da11fe2f/users/23b5a21b71b14b7f930daa3d63b20f42/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:32.117919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3003e1-4be0-4e33-b3a8-051a7bc240a3 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:32.124184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9a3003e1-4be0-4e33-b3a8-051a7bc240a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:32.232511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3003e1-4be0-4e33-b3a8-051a7bc240a3 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:32.236168 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 878/1755] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:32.237841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d322be-0723-4e71-9548-a407bacd7960 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:32.252405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-53d322be-0723-4e71-9548-a407bacd7960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:32.266475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:32.267480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:32.274432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:32.274432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] PATH_INFO: `/v3/users/32aa4ac28f454c36a375d4a174294ec4` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:32.274432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32aa4ac28f454c36a375d4a174294ec4)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:32.274432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:32.290664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d322be-0723-4e71-9548-a407bacd7960 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:32.383265 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32aa4ac28f454c36a375d4a174294ec4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:32.410378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32aa4ac28f454c36a375d4a174294ec4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:32.411784 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32aa4ac28f454c36a375d4a174294ec4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:32.412133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32aa4ac28f454c36a375d4a174294ec4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:32.431933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bd058-6aa1-44b2-9af2-acc149221f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:32.432778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd058-6aa1-44b2-9af2-acc149221f72 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:32.433026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32aa4ac28f454c36a375d4a174294ec4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:32.433266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd058-6aa1-44b2-9af2-acc149221f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:32.433683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bd058-6aa1-44b2-9af2-acc149221f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:32.444834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-023bd058-6aa1-44b2-9af2-acc149221f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:32.460342 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 878/1756] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:32 2022] DELETE /identity/v3/users/32aa4ac28f454c36a375d4a174294ec4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:32.460342 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:32.463890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:32.466625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bd058-6aa1-44b2-9af2-acc149221f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:32.478138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bd058-6aa1-44b2-9af2-acc149221f72 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:32.544292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 879/1757] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:32.547313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1d89e-25cf-45f4-9959-bca98e80d0c7 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:32.549908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1d89e-25cf-45f4-9959-bca98e80d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:32.549908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1d89e-25cf-45f4-9959-bca98e80d0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:32.584287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a6543-1a4b-42ab-89c6-3ae2e6c1b575 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:32.602820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8178-e82c-4846-8a2a-444fb047be93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:32.606115 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8178-e82c-4846-8a2a-444fb047be93 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:32.606494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8178-e82c-4846-8a2a-444fb047be93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:32.606786 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8178-e82c-4846-8a2a-444fb047be93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:32.612449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b6df8178-e82c-4846-8a2a-444fb047be93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:32.690067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-a2e1d89e-25cf-45f4-9959-bca98e80d0c7 None None] MFA Rules not processed for user `23b5a21b71b14b7f930daa3d63b20f42`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:32.695449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a2e1d89e-25cf-45f4-9959-bca98e80d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:32.806282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8178-e82c-4846-8a2a-444fb047be93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:32.813134 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8178-e82c-4846-8a2a-444fb047be93 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:32.842593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 879/1758] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:32.844069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8178-e82c-4846-8a2a-444fb047be93 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:32.845595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b6df8178-e82c-4846-8a2a-444fb047be93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:32.896114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 880/1759] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:32 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:32.899211 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dd439-c96f-48de-88a8-1ba6e89a1bf8 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:32.908815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dd439-c96f-48de-88a8-1ba6e89a1bf8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:32.913542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66dd439-c96f-48de-88a8-1ba6e89a1bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:33.004159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-d66dd439-c96f-48de-88a8-1ba6e89a1bf8 None None] MFA Rules not processed for user `c6422873a3b84aac88f8a93291bcd7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:33.012415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d66dd439-c96f-48de-88a8-1ba6e89a1bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:33.032197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8178-e82c-4846-8a2a-444fb047be93 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:33.055818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0abe2b-6a65-4f34-a92d-0f4201d71267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:33.056507 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0abe2b-6a65-4f34-a92d-0f4201d71267 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:33.056789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0abe2b-6a65-4f34-a92d-0f4201d71267 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:33.057072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0abe2b-6a65-4f34-a92d-0f4201d71267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:33.066225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-fa0abe2b-6a65-4f34-a92d-0f4201d71267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:33.140010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 881/1760] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:33.142024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ea771-1f78-46c7-a8b9-f7268de669fa None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:33.142356 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ea771-1f78-46c7-a8b9-f7268de669fa None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:33.142791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ea771-1f78-46c7-a8b9-f7268de669fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:33.206327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0abe2b-6a65-4f34-a92d-0f4201d71267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:33.208680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0abe2b-6a65-4f34-a92d-0f4201d71267 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:33.231812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 880/1761] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:33.235819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0abe2b-6a65-4f34-a92d-0f4201d71267 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:33.240832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-fa0abe2b-6a65-4f34-a92d-0f4201d71267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:33.241823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-070ea771-1f78-46c7-a8b9-f7268de669fa None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:33.243046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-070ea771-1f78-46c7-a8b9-f7268de669fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:33.264769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0abe2b-6a65-4f34-a92d-0f4201d71267 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:33.282049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 882/1762] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:33.297248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ea771-1f78-46c7-a8b9-f7268de669fa None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:33.299983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-070ea771-1f78-46c7-a8b9-f7268de669fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:33.309212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950d25-b2c3-45d0-a90c-4b12e9513a0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:33.310139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950d25-b2c3-45d0-a90c-4b12e9513a0d service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:33.310524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950d25-b2c3-45d0-a90c-4b12e9513a0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:33.310928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950d25-b2c3-45d0-a90c-4b12e9513a0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:33.324468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68950d25-b2c3-45d0-a90c-4b12e9513a0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:33.326123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68950d25-b2c3-45d0-a90c-4b12e9513a0d service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:33.338292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ea771-1f78-46c7-a8b9-f7268de669fa None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:33.347841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cb7a5-1e7c-45d5-b067-7efea394c157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:33.349272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cb7a5-1e7c-45d5-b067-7efea394c157 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:33.349272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cb7a5-1e7c-45d5-b067-7efea394c157 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:33.349272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cb7a5-1e7c-45d5-b067-7efea394c157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:33.359574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 881/1763] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:33 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:33.366139 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cb7a5-1e7c-45d5-b067-7efea394c157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:33.367904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cb7a5-1e7c-45d5-b067-7efea394c157 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:33.389803 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 883/1764] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:31:33.496604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950d25-b2c3-45d0-a90c-4b12e9513a0d service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:33.506738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950d25-b2c3-45d0-a90c-4b12e9513a0d service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:33.518737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4502f-1f52-458b-bed9-078b2da3b5ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:33.521935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4502f-1f52-458b-bed9-078b2da3b5ab service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:33.522613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4502f-1f52-458b-bed9-078b2da3b5ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:33.523816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4502f-1f52-458b-bed9-078b2da3b5ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:33.530187 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-acb4502f-1f52-458b-bed9-078b2da3b5ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:33.704356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4502f-1f52-458b-bed9-078b2da3b5ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:33.708830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4502f-1f52-458b-bed9-078b2da3b5ab service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:33.726535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 882/1765] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:33 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:34.223321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cb7a5-1e7c-45d5-b067-7efea394c157 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:34.224837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4d6cb7a5-1e7c-45d5-b067-7efea394c157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:34.248574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cb7a5-1e7c-45d5-b067-7efea394c157 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:34.262284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:34.264580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:34.264966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:34.265210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] PATH_INFO: `/v3/projects/1ecfb7b9e3d14711b14409f03c7367ee` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:34.268525 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ecfb7b9e3d14711b14409f03c7367ee)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:34.271406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4502f-1f52-458b-bed9-078b2da3b5ab service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:34.273846 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-acb4502f-1f52-458b-bed9-078b2da3b5ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:34.303117 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:34.323713 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4502f-1f52-458b-bed9-078b2da3b5ab service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:34.353514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:34.354916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:34.355225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:34.355487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] PATH_INFO: `/v3/projects/b7ed5932615343aa9d806ed2a38c603d` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:34.359993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7ed5932615343aa9d806ed2a38c603d)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:34.362429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:34.448184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ecfb7b9e3d14711b14409f03c7367ee', 'request_id': 'req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:34.452280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7ed5932615343aa9d806ed2a38c603d', 'request_id': 'req-463a13b9-b0b5-48fb-a980-a2f5932f643c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:34.459241 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ecfb7b9e3d14711b14409f03c7367ee', 'request_id': 'req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:34.465017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7ed5932615343aa9d806ed2a38c603d', 'request_id': 'req-463a13b9-b0b5-48fb-a980-a2f5932f643c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:34.477319 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7ed5932615343aa9d806ed2a38c603d', 'request_id': 'req-463a13b9-b0b5-48fb-a980-a2f5932f643c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:34.481545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ecfb7b9e3d14711b14409f03c7367ee', 'request_id': 'req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:34.504063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] The token cache is being invalidate because project 1ecfb7b9e3d14711b14409f03c7367ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:34.505171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:34.506003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:34.510116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 884/1766] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:34 2022] DELETE /identity/v3/projects/1ecfb7b9e3d14711b14409f03c7367ee => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:34.515494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:34.518030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] The token cache is being invalidate because project b7ed5932615343aa9d806ed2a38c603d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:34.518328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:34.519001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-463a13b9-b0b5-48fb-a980-a2f5932f643c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:34.521062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:34.524535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 883/1767] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:34 2022] DELETE /identity/v3/projects/b7ed5932615343aa9d806ed2a38c603d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:34.526036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dcae0-fef2-4e68-bad9-43e979c8388c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:34.526325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dcae0-fef2-4e68-bad9-43e979c8388c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:34.526609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dcae0-fef2-4e68-bad9-43e979c8388c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:34.580183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6a2dcae0-fef2-4e68-bad9-43e979c8388c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:34.585585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6a2dcae0-fef2-4e68-bad9-43e979c8388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:34.686726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d69f-6ef7-4a09-890a-9d1c86ab4704 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:34.724676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 884/1768] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:34.733180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982676f8-2162-41c8-8b35-980354f33ff1 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:34.733642 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982676f8-2162-41c8-8b35-980354f33ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:34.734186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982676f8-2162-41c8-8b35-980354f33ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:34.781117 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-982676f8-2162-41c8-8b35-980354f33ff1 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:34.782515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-982676f8-2162-41c8-8b35-980354f33ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:34.802367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 885/1769] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:31:34.806983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982676f8-2162-41c8-8b35-980354f33ff1 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:34.824178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982676f8-2162-41c8-8b35-980354f33ff1 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:34.828228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:34.829368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:34.829913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:34.831557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] PATH_INFO: `/v3/users/6d484bfcad9d452ea706f5f1ab11135a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:34.834573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d484bfcad9d452ea706f5f1ab11135a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:34.839124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:34.841922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7110f-a439-4291-b86d-abc89b17b787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:34.844285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7110f-a439-4291-b86d-abc89b17b787 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:34.844843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7110f-a439-4291-b86d-abc89b17b787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:34.845287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7110f-a439-4291-b86d-abc89b17b787 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:34.847500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7110f-a439-4291-b86d-abc89b17b787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:34.849126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7110f-a439-4291-b86d-abc89b17b787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:34.850919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7110f-a439-4291-b86d-abc89b17b787 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:34.883391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 886/1770] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:34.886843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7110f-a439-4291-b86d-abc89b17b787 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:34.906917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7110f-a439-4291-b86d-abc89b17b787 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:34.914483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb5b4-6a52-4972-8288-e412dcb8d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:34.915580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb5b4-6a52-4972-8288-e412dcb8d22a admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:34.916035 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb5b4-6a52-4972-8288-e412dcb8d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:34.916708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffb5b4-6a52-4972-8288-e412dcb8d22a admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:34.917621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb5b4-6a52-4972-8288-e412dcb8d22a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:34.920985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffb5b4-6a52-4972-8288-e412dcb8d22a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:35.004546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 887/1771] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:34 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:35.006159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb5b4-6a52-4972-8288-e412dcb8d22a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:35.106327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d484bfcad9d452ea706f5f1ab11135a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:35.114995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d484bfcad9d452ea706f5f1ab11135a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:35.145654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffb5b4-6a52-4972-8288-e412dcb8d22a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:35.147882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d484bfcad9d452ea706f5f1ab11135a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:35.149748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d484bfcad9d452ea706f5f1ab11135a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:35.164070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d484bfcad9d452ea706f5f1ab11135a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:35.174139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc078908-f825-4bc8-9453-b8f838b3778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:35.174838 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078908-f825-4bc8-9453-b8f838b3778f admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:35.177429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078908-f825-4bc8-9453-b8f838b3778f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:35.177873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc078908-f825-4bc8-9453-b8f838b3778f admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:35.178739 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc078908-f825-4bc8-9453-b8f838b3778f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:35.183103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc078908-f825-4bc8-9453-b8f838b3778f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:35.209371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 885/1772] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:34 2022] DELETE /identity/v3/users/6d484bfcad9d452ea706f5f1ab11135a => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:35.214820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:35.215060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 888/1773] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:35 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:35.216438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:35.271557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8894e88-b8a3-4d17-b501-83f1ecafb310 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:35.272160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8894e88-b8a3-4d17-b501-83f1ecafb310 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:35.272160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8894e88-b8a3-4d17-b501-83f1ecafb310 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:35.274528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 889/1774] 10.222.0.75 () {54 vars in 912 bytes} [Thu May 12 14:31:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:35.281027 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d537bc-7984-4f8d-b64b-a460b383ac6b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:35.281403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d537bc-7984-4f8d-b64b-a460b383ac6b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:35.281692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d537bc-7984-4f8d-b64b-a460b383ac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:35.338925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-51d537bc-7984-4f8d-b64b-a460b383ac6b None None] MFA Rules not processed for user `5aca248c2e074fc4baff39930e21fe29`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:35.340528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-51d537bc-7984-4f8d-b64b-a460b383ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:35.391746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca301518-f488-43cf-a750-494e8ff73f9b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:35.401118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc04945-619e-4740-b5bb-2f1a4e6f3913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:35.402178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc04945-619e-4740-b5bb-2f1a4e6f3913 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:35.403055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc04945-619e-4740-b5bb-2f1a4e6f3913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:35.403592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc04945-619e-4740-b5bb-2f1a4e6f3913 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:35.404483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc04945-619e-4740-b5bb-2f1a4e6f3913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:35.407309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc04945-619e-4740-b5bb-2f1a4e6f3913 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:35.438317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 886/1775] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:35.446756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc04945-619e-4740-b5bb-2f1a4e6f3913 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:35.468623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc04945-619e-4740-b5bb-2f1a4e6f3913 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:35.477429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bf3a8-e62c-452f-9ddb-dc1db3a06098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:35.478451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bf3a8-e62c-452f-9ddb-dc1db3a06098 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:35.479806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bf3a8-e62c-452f-9ddb-dc1db3a06098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:35.480707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bf3a8-e62c-452f-9ddb-dc1db3a06098 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:35.482310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 890/1776] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:31:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 12 14:31:35.483051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bf3a8-e62c-452f-9ddb-dc1db3a06098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:35.487195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bf3a8-e62c-452f-9ddb-dc1db3a06098 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:35.509200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 887/1777] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:35.513419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d537bc-7984-4f8d-b64b-a460b383ac6b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:35.537582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d537bc-7984-4f8d-b64b-a460b383ac6b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:35.559301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3225fd-7e9a-4375-970a-084056712771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:35.562506 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3225fd-7e9a-4375-970a-084056712771 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:35.563535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3225fd-7e9a-4375-970a-084056712771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:35.564807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3225fd-7e9a-4375-970a-084056712771 admin admin] PATH_INFO: `/v3/projects/25dba82031df4b04a81213933bddf78e/users/bd29830540b64091bdbafd09000e0813/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:35.626243 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3225fd-7e9a-4375-970a-084056712771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25dba82031df4b04a81213933bddf78e, user_id=bd29830540b64091bdbafd09000e0813, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:35.629497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3225fd-7e9a-4375-970a-084056712771 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:35.669268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73696-b469-476c-bfbd-0405a5bf00d6 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:35.669957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73696-b469-476c-bfbd-0405a5bf00d6 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:35.670130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 891/1778] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:35 2022] PUT /identity/v3/projects/25dba82031df4b04a81213933bddf78e/users/bd29830540b64091bdbafd09000e0813/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:35.670520 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73696-b469-476c-bfbd-0405a5bf00d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:35.720831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3225fd-7e9a-4375-970a-084056712771 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:35.723714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0c3225fd-7e9a-4375-970a-084056712771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:35.755249 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-58c73696-b469-476c-bfbd-0405a5bf00d6 None None] MFA Rules not processed for user `bd29830540b64091bdbafd09000e0813`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:35.761081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-58c73696-b469-476c-bfbd-0405a5bf00d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:35.952395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3225fd-7e9a-4375-970a-084056712771 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:35.979803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87642cb6-4a68-4c43-be53-8abcf98d5dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:35.980490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87642cb6-4a68-4c43-be53-8abcf98d5dcf service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:35.980773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87642cb6-4a68-4c43-be53-8abcf98d5dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:35.981233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87642cb6-4a68-4c43-be53-8abcf98d5dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:35.990793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 888/1779] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:31:35.990793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b669e3-f262-4559-82e6-5a17176df92d None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:35.990793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b669e3-f262-4559-82e6-5a17176df92d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:35.990793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b669e3-f262-4559-82e6-5a17176df92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.026941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b7b669e3-f262-4559-82e6-5a17176df92d None None] MFA Rules not processed for user `c3b76edcb338405a9bf2f68e91dfacdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:36.030911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87642cb6-4a68-4c43-be53-8abcf98d5dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:36.036520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87642cb6-4a68-4c43-be53-8abcf98d5dcf service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:36.037045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b7b669e3-f262-4559-82e6-5a17176df92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:36.066231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 892/1780] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:31:36.068550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87642cb6-4a68-4c43-be53-8abcf98d5dcf service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:36.074346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-87642cb6-4a68-4c43-be53-8abcf98d5dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:36.111773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 889/1781] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:36.112783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b669e3-f262-4559-82e6-5a17176df92d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:36.114673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b7b669e3-f262-4559-82e6-5a17176df92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:36.254373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87642cb6-4a68-4c43-be53-8abcf98d5dcf service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:36.263828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b669e3-f262-4559-82e6-5a17176df92d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:36.272560 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:36.273458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:36.273745 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:36.274024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] PATH_INFO: `/v3/projects/8b0997e5ef524b869aab4174a7030165` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.275509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0997e5ef524b869aab4174a7030165)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:36.278713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40f8e6-abd1-4e50-b3f7-04b4106dd0e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:36.279562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:36.279782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f8e6-abd1-4e50-b3f7-04b4106dd0e5 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:36.280174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f8e6-abd1-4e50-b3f7-04b4106dd0e5 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:36.280560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f8e6-abd1-4e50-b3f7-04b4106dd0e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.291723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40f8e6-abd1-4e50-b3f7-04b4106dd0e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:36.294627 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40f8e6-abd1-4e50-b3f7-04b4106dd0e5 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:36.305986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 890/1782] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:36.373923 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0997e5ef524b869aab4174a7030165', 'request_id': 'req-35e950f0-dc98-4fa8-8165-2d0a00f91607'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:36.394009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0997e5ef524b869aab4174a7030165', 'request_id': 'req-35e950f0-dc98-4fa8-8165-2d0a00f91607'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:36.404631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0997e5ef524b869aab4174a7030165', 'request_id': 'req-35e950f0-dc98-4fa8-8165-2d0a00f91607'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:36.418548 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] The token cache is being invalidate because project 8b0997e5ef524b869aab4174a7030165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:36.418839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:36.419590 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-35e950f0-dc98-4fa8-8165-2d0a00f91607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:36.423085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 893/1783] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:36 2022] DELETE /identity/v3/projects/8b0997e5ef524b869aab4174a7030165 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:36.427775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a507e0-0291-4b6b-99f4-48014c25b596 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:36.428773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a507e0-0291-4b6b-99f4-48014c25b596 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:36.429256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a507e0-0291-4b6b-99f4-48014c25b596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.458265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-f6a507e0-0291-4b6b-99f4-48014c25b596 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:36.459595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f6a507e0-0291-4b6b-99f4-48014c25b596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:36.550801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 891/1784] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:36.559775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997d6a-07ef-41c1-9b3d-33a5f3b0ba04 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:36.560059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997d6a-07ef-41c1-9b3d-33a5f3b0ba04 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:36.560769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15997d6a-07ef-41c1-9b3d-33a5f3b0ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.583410 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-15997d6a-07ef-41c1-9b3d-33a5f3b0ba04 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:36.584715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-15997d6a-07ef-41c1-9b3d-33a5f3b0ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:36.597000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 894/1785] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:36.601527 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a507e0-0291-4b6b-99f4-48014c25b596 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:36.611202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a507e0-0291-4b6b-99f4-48014c25b596 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:36.616329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56dc60-c898-420f-9f79-e4177d179b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:36.617066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56dc60-c898-420f-9f79-e4177d179b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:36.617447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56dc60-c898-420f-9f79-e4177d179b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:36.617810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56dc60-c898-420f-9f79-e4177d179b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.618725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56dc60-c898-420f-9f79-e4177d179b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:36.619010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56dc60-c898-420f-9f79-e4177d179b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:36.620952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56dc60-c898-420f-9f79-e4177d179b8b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:36.630487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a3b6-ce44-4840-b643-6cfb63dc225b None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:36.630782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a3b6-ce44-4840-b643-6cfb63dc225b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:36.631087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31a3b6-ce44-4840-b643-6cfb63dc225b None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.632849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 895/1786] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:31:36.645862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 892/1787] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:36.647212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31a3b6-ce44-4840-b643-6cfb63dc225b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:36.661215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31a3b6-ce44-4840-b643-6cfb63dc225b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:36.666233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25188236-51e0-4d8d-bc58-80f7d963a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:36.666909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25188236-51e0-4d8d-bc58-80f7d963a842 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:36.667239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25188236-51e0-4d8d-bc58-80f7d963a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:36.667525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25188236-51e0-4d8d-bc58-80f7d963a842 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.668233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25188236-51e0-4d8d-bc58-80f7d963a842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:36.670182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25188236-51e0-4d8d-bc58-80f7d963a842 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:36.702149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 896/1788] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:36 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:36.706354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56dc60-c898-420f-9f79-e4177d179b8b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:36.722897 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56dc60-c898-420f-9f79-e4177d179b8b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:36.794945 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca55a5-db19-4c49-9771-68c9ec073601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:36.795693 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca55a5-db19-4c49-9771-68c9ec073601 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:36.796161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca55a5-db19-4c49-9771-68c9ec073601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:36.796446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca55a5-db19-4c49-9771-68c9ec073601 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.797159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca55a5-db19-4c49-9771-68c9ec073601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:36.804735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25188236-51e0-4d8d-bc58-80f7d963a842 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:36.805137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca55a5-db19-4c49-9771-68c9ec073601 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:36.806948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-25188236-51e0-4d8d-bc58-80f7d963a842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:36.822308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25188236-51e0-4d8d-bc58-80f7d963a842 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:36.828915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:36.830070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:36.831823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:36.832485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] PATH_INFO: `/v3/users/bca2b91e85a4406e8dec4c995b67cc37` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.834095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca2b91e85a4406e8dec4c995b67cc37)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:36.836427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:36.841126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 893/1789] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:36 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:36.841126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abdd38-7bb7-4dc3-96a1-c43b2eeca9ca None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:36.841126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abdd38-7bb7-4dc3-96a1-c43b2eeca9ca None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:36.841126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abdd38-7bb7-4dc3-96a1-c43b2eeca9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:36.859736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-75abdd38-7bb7-4dc3-96a1-c43b2eeca9ca None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:36.860954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-75abdd38-7bb7-4dc3-96a1-c43b2eeca9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:36.916222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca2b91e85a4406e8dec4c995b67cc37'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:36.939711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca2b91e85a4406e8dec4c995b67cc37'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:36.940082 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca2b91e85a4406e8dec4c995b67cc37'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:36.944103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca2b91e85a4406e8dec4c995b67cc37'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:36.985384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 894/1790] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:31:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:36.986347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abdd38-7bb7-4dc3-96a1-c43b2eeca9ca None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:36.988136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-75abdd38-7bb7-4dc3-96a1-c43b2eeca9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:36.991628 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0a68322c-67f1-481b-8a74-59912d32d932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca2b91e85a4406e8dec4c995b67cc37'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:37.014684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abdd38-7bb7-4dc3-96a1-c43b2eeca9ca None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:37.027305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6bb8-4062-4148-9d44-a3056b0fa73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:37.027866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 897/1791] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:36 2022] DELETE /identity/v3/users/bca2b91e85a4406e8dec4c995b67cc37 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:37.028740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6bb8-4062-4148-9d44-a3056b0fa73f admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:37.028947 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6bb8-4062-4148-9d44-a3056b0fa73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:37.029264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6bb8-4062-4148-9d44-a3056b0fa73f admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:37.030032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e6bb8-4062-4148-9d44-a3056b0fa73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:37.038123 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e6bb8-4062-4148-9d44-a3056b0fa73f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:37.039523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030629a-d9df-43f7-8692-25da3c9b771a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:37.040033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030629a-d9df-43f7-8692-25da3c9b771a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:37.040544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030629a-d9df-43f7-8692-25da3c9b771a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:37.075784 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d030629a-d9df-43f7-8692-25da3c9b771a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:37.077403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d030629a-d9df-43f7-8692-25da3c9b771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:37.080707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 895/1792] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:37.085097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6bb8-4062-4148-9d44-a3056b0fa73f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:37.103053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6bb8-4062-4148-9d44-a3056b0fa73f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:37.154943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 898/1793] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:37.167405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030629a-d9df-43f7-8692-25da3c9b771a None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:37.168791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d030629a-d9df-43f7-8692-25da3c9b771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:37.235600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cf558-de46-445d-980a-93a0f3ea1877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:37.240365 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cf558-de46-445d-980a-93a0f3ea1877 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:37.240785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cf558-de46-445d-980a-93a0f3ea1877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:37.241172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cf558-de46-445d-980a-93a0f3ea1877 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:37.242120 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cf558-de46-445d-980a-93a0f3ea1877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:37.243925 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cf558-de46-445d-980a-93a0f3ea1877 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:37.273120 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 896/1794] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:31:37.274377 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cf558-de46-445d-980a-93a0f3ea1877 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:37.276158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0a1cf558-de46-445d-980a-93a0f3ea1877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:37.296799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030629a-d9df-43f7-8692-25da3c9b771a None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:37.302398 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bca95c-8bc8-4309-b665-e0038f029099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:37.303433 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bca95c-8bc8-4309-b665-e0038f029099 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:37.303960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bca95c-8bc8-4309-b665-e0038f029099 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:37.304558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bca95c-8bc8-4309-b665-e0038f029099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:37.321176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bca95c-8bc8-4309-b665-e0038f029099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:37.322715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bca95c-8bc8-4309-b665-e0038f029099 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:37.356977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 899/1795] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:37.357830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bca95c-8bc8-4309-b665-e0038f029099 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:37.374370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bca95c-8bc8-4309-b665-e0038f029099 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:37.391614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c62ff2-4ed8-4856-a56c-baea3edabc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:37.391830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cf558-de46-445d-980a-93a0f3ea1877 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:37.392539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c62ff2-4ed8-4856-a56c-baea3edabc6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:37.392825 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c62ff2-4ed8-4856-a56c-baea3edabc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:37.393106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c62ff2-4ed8-4856-a56c-baea3edabc6d admin admin] PATH_INFO: `/v3/projects/a58364cd68cc490ba5ba5ccc7f267ae7/users/cd481618372840838cc771b81c99c0a6/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:37.416134 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479161f-1fb3-42eb-a2bf-92b2623e7aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:37.416837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479161f-1fb3-42eb-a2bf-92b2623e7aae service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:37.417404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479161f-1fb3-42eb-a2bf-92b2623e7aae service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:37.417717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479161f-1fb3-42eb-a2bf-92b2623e7aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:37.430958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c62ff2-4ed8-4856-a56c-baea3edabc6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58364cd68cc490ba5ba5ccc7f267ae7, user_id=cd481618372840838cc771b81c99c0a6, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:37.434593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c62ff2-4ed8-4856-a56c-baea3edabc6d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:37.446663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479161f-1fb3-42eb-a2bf-92b2623e7aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:37.448370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479161f-1fb3-42eb-a2bf-92b2623e7aae service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:37.468399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 900/1796] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:37 2022] PUT /identity/v3/projects/a58364cd68cc490ba5ba5ccc7f267ae7/users/cd481618372840838cc771b81c99c0a6/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:37.481097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92793e06-237d-4239-b413-958d3c0b5f3c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:37.481203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92793e06-237d-4239-b413-958d3c0b5f3c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:37.481504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92793e06-237d-4239-b413-958d3c0b5f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:37.481875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 897/1797] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:37.534397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-92793e06-237d-4239-b413-958d3c0b5f3c None None] MFA Rules not processed for user `cd481618372840838cc771b81c99c0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:37.536047 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-92793e06-237d-4239-b413-958d3c0b5f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:37.671094 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 901/1798] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:31:37.673060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479161f-1fb3-42eb-a2bf-92b2623e7aae service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:37.694521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479161f-1fb3-42eb-a2bf-92b2623e7aae service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:37.820848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdbdff-d6d4-427c-b2ae-29c7640c1a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:37.822294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdbdff-d6d4-427c-b2ae-29c7640c1a5c admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:37.822586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdbdff-d6d4-427c-b2ae-29c7640c1a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:37.822869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdbdff-d6d4-427c-b2ae-29c7640c1a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:37.827989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdbdff-d6d4-427c-b2ae-29c7640c1a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:37.830424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdbdff-d6d4-427c-b2ae-29c7640c1a5c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:37.954743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 898/1799] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:37 2022] POST /identity/v3/projects => generated 381 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:37.955861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92793e06-237d-4239-b413-958d3c0b5f3c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:37.981433 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92793e06-237d-4239-b413-958d3c0b5f3c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:38.167879 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ea074-c9b6-4a1b-8274-f21c28dec48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:38.168593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ea074-c9b6-4a1b-8274-f21c28dec48d admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:38.168883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ea074-c9b6-4a1b-8274-f21c28dec48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:38.169160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ea074-c9b6-4a1b-8274-f21c28dec48d admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:38.169874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ea074-c9b6-4a1b-8274-f21c28dec48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:38.179993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ea074-c9b6-4a1b-8274-f21c28dec48d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:38.264681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 902/1800] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:37 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:38.268428 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdbdff-d6d4-427c-b2ae-29c7640c1a5c admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:38.282609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdbdff-d6d4-427c-b2ae-29c7640c1a5c admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:38.295916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baee5af-cc36-45ec-af59-16bf761b148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:38.300312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baee5af-cc36-45ec-af59-16bf761b148c admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:38.300312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baee5af-cc36-45ec-af59-16bf761b148c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:38.300312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baee5af-cc36-45ec-af59-16bf761b148c admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:38.303409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baee5af-cc36-45ec-af59-16bf761b148c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:38.305556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baee5af-cc36-45ec-af59-16bf761b148c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:38.341859 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ea074-c9b6-4a1b-8274-f21c28dec48d admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:38.344358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cb5ea074-c9b6-4a1b-8274-f21c28dec48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:38.366407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ea074-c9b6-4a1b-8274-f21c28dec48d admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:38.368561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 899/1801] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:38.373403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baee5af-cc36-45ec-af59-16bf761b148c admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:38.383514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:38.384400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:38.384685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:38.385065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] PATH_INFO: `/v3/projects/63f89b9869c542499a423a75997976f9` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:38.387218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f89b9869c542499a423a75997976f9)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:38.389212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:38.403238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baee5af-cc36-45ec-af59-16bf761b148c admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:38.411459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed01b05-3612-4449-a6a9-c918a7917174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:38.412360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed01b05-3612-4449-a6a9-c918a7917174 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:38.412642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed01b05-3612-4449-a6a9-c918a7917174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:38.412990 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed01b05-3612-4449-a6a9-c918a7917174 admin admin] PATH_INFO: `/v3/projects/2e34396c619d4117b04068943653c2c3/users/3c64a0e117b54a66869053475e343996/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:38.437984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed01b05-3612-4449-a6a9-c918a7917174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e34396c619d4117b04068943653c2c3, user_id=3c64a0e117b54a66869053475e343996, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:38.441039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed01b05-3612-4449-a6a9-c918a7917174 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:38.463866 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 900/1802] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:38 2022] PUT /identity/v3/projects/2e34396c619d4117b04068943653c2c3/users/3c64a0e117b54a66869053475e343996/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:38.465867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed01b05-3612-4449-a6a9-c918a7917174 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:38.468598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5ed01b05-3612-4449-a6a9-c918a7917174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:38.484772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f89b9869c542499a423a75997976f9', 'request_id': 'req-8799296d-9038-4fee-a252-514035ae4da8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.503820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f89b9869c542499a423a75997976f9', 'request_id': 'req-8799296d-9038-4fee-a252-514035ae4da8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.512701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f89b9869c542499a423a75997976f9', 'request_id': 'req-8799296d-9038-4fee-a252-514035ae4da8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.538060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] The token cache is being invalidate because project 63f89b9869c542499a423a75997976f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:38.538873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.539991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.543078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 903/1803] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:38 2022] DELETE /identity/v3/projects/63f89b9869c542499a423a75997976f9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:38.544305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:38.546366 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:38.574789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed01b05-3612-4449-a6a9-c918a7917174 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:38.664401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:38.665861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:38.666238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:38.666461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] PATH_INFO: `/v3/users/bd29830540b64091bdbafd09000e0813` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:38.673759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd29830540b64091bdbafd09000e0813)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:38.684824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:38.694343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799296d-9038-4fee-a252-514035ae4da8 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:38.701537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bcd14-4125-46e0-86eb-c6e537d6d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:38.702310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bcd14-4125-46e0-86eb-c6e537d6d5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:38.702589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bcd14-4125-46e0-86eb-c6e537d6d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:38.703195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bcd14-4125-46e0-86eb-c6e537d6d5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:38.705340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bcd14-4125-46e0-86eb-c6e537d6d5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:38.712617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bcd14-4125-46e0-86eb-c6e537d6d5a9 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:38.739269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 904/1804] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:38.740898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bcd14-4125-46e0-86eb-c6e537d6d5a9 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:38.744275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4f5bcd14-4125-46e0-86eb-c6e537d6d5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:38.768573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bcd14-4125-46e0-86eb-c6e537d6d5a9 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:38.777251 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd29830540b64091bdbafd09000e0813'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.777437 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:38.778451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd29830540b64091bdbafd09000e0813'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.779003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:38.779602 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:38.780348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] PATH_INFO: `/v3/users/3c323223819c432d8478e4849adf1d9b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:38.783780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c323223819c432d8478e4849adf1d9b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:38.788578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd29830540b64091bdbafd09000e0813'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.788728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:38.789394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd29830540b64091bdbafd09000e0813'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.799539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd29830540b64091bdbafd09000e0813'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.838171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 901/1805] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:38 2022] DELETE /identity/v3/users/bd29830540b64091bdbafd09000e0813 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:38.839354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:38.842555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:38.861371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c323223819c432d8478e4849adf1d9b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.869536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c323223819c432d8478e4849adf1d9b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.870246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c323223819c432d8478e4849adf1d9b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.870875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c323223819c432d8478e4849adf1d9b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.882889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-38b78f7a-47d1-470f-899e-7d16fd194cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c323223819c432d8478e4849adf1d9b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:38.897791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 905/1806] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:38 2022] DELETE /identity/v3/users/3c323223819c432d8478e4849adf1d9b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:38.902039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a12c35-0b46-4a5d-8385-6cab46ecb799 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:38.902337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a12c35-0b46-4a5d-8385-6cab46ecb799 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:38.902623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a12c35-0b46-4a5d-8385-6cab46ecb799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:38.914275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717968a5-66b9-4764-b449-a39d0b00ee03 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:38.922973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-33a12c35-0b46-4a5d-8385-6cab46ecb799 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:38.924268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-33a12c35-0b46-4a5d-8385-6cab46ecb799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:38.989961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7f72f-0d71-4fae-a251-b8693ca179c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:38.992045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7f72f-0d71-4fae-a251-b8693ca179c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:38.992479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7f72f-0d71-4fae-a251-b8693ca179c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:38.992962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7f72f-0d71-4fae-a251-b8693ca179c6 admin admin] PATH_INFO: `/v3/projects/2e34396c619d4117b04068943653c2c3/users/3c64a0e117b54a66869053475e343996/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:38.997394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7f72f-0d71-4fae-a251-b8693ca179c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e34396c619d4117b04068943653c2c3, user_id=3c64a0e117b54a66869053475e343996, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.001684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7f72f-0d71-4fae-a251-b8693ca179c6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.016678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 902/1807] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:38 2022] PUT /identity/v3/projects/2e34396c619d4117b04068943653c2c3/users/3c64a0e117b54a66869053475e343996/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:39.028961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32a49e-7916-4b35-be15-40679e42c7d2 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.029251 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32a49e-7916-4b35-be15-40679e42c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.029530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32a49e-7916-4b35-be15-40679e42c7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.039093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 906/1808] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:39.046274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a12c35-0b46-4a5d-8385-6cab46ecb799 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.054940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-33a12c35-0b46-4a5d-8385-6cab46ecb799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.089773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-cc32a49e-7916-4b35-be15-40679e42c7d2 None None] MFA Rules not processed for user `3c64a0e117b54a66869053475e343996`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:39.093003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cc32a49e-7916-4b35-be15-40679e42c7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.139592 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a12c35-0b46-4a5d-8385-6cab46ecb799 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:39.188587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 903/1809] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:31:39.204992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32a49e-7916-4b35-be15-40679e42c7d2 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.206910 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cc32a49e-7916-4b35-be15-40679e42c7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.214287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b24670-7fb4-4161-861a-de6c6a4462d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:39.215239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b24670-7fb4-4161-861a-de6c6a4462d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.215375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b24670-7fb4-4161-861a-de6c6a4462d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.215818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b24670-7fb4-4161-861a-de6c6a4462d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.320072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b24670-7fb4-4161-861a-de6c6a4462d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.323818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b24670-7fb4-4161-861a-de6c6a4462d8 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.327647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32a49e-7916-4b35-be15-40679e42c7d2 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:39.331809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace266a8-91b1-45c2-b800-360ebbef9ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:39.333225 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace266a8-91b1-45c2-b800-360ebbef9ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.333580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace266a8-91b1-45c2-b800-360ebbef9ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.333909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 907/1810] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:31:39.334056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace266a8-91b1-45c2-b800-360ebbef9ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.335656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b24670-7fb4-4161-861a-de6c6a4462d8 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.337273 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-74b24670-7fb4-4161-861a-de6c6a4462d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.345050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace266a8-91b1-45c2-b800-360ebbef9ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.346648 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace266a8-91b1-45c2-b800-360ebbef9ee3 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.351205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b24670-7fb4-4161-861a-de6c6a4462d8 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:39.356559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:39.357396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 904/1811] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:39.359230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.359887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.360061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] PATH_INFO: `/v3/projects/1d52cd3e9725476eb826b68f1026bc52` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.361403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d52cd3e9725476eb826b68f1026bc52)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.363563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.425640 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d52cd3e9725476eb826b68f1026bc52', 'request_id': 'req-74fb51a9-33d0-4c52-a520-06a7b6169a6a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:39.438861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d52cd3e9725476eb826b68f1026bc52', 'request_id': 'req-74fb51a9-33d0-4c52-a520-06a7b6169a6a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:39.441287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d52cd3e9725476eb826b68f1026bc52', 'request_id': 'req-74fb51a9-33d0-4c52-a520-06a7b6169a6a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:39.455317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] The token cache is being invalidate because project 1d52cd3e9725476eb826b68f1026bc52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:39.455730 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:39.456744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:39.458917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 908/1812] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:39 2022] DELETE /identity/v3/projects/1d52cd3e9725476eb826b68f1026bc52 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:39.467754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba183e-c159-4802-bdcf-fa627543803b None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.468289 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba183e-c159-4802-bdcf-fa627543803b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.468806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba183e-c159-4802-bdcf-fa627543803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.471344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.473287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.487879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-feba183e-c159-4802-bdcf-fa627543803b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:39.489192 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-feba183e-c159-4802-bdcf-fa627543803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.537185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb51a9-33d0-4c52-a520-06a7b6169a6a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:39.540925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bbbd7-86ac-48df-a23b-512396c34368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:39.541693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bbbd7-86ac-48df-a23b-512396c34368 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.541849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bbbd7-86ac-48df-a23b-512396c34368 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.542076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bbbd7-86ac-48df-a23b-512396c34368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.543961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b00bbbd7-86ac-48df-a23b-512396c34368 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.559643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 905/1813] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:39.567734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c23f7-1b7c-488d-b8ee-6794883dd15e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.568027 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c23f7-1b7c-488d-b8ee-6794883dd15e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.568306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c23f7-1b7c-488d-b8ee-6794883dd15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.591115 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-745c23f7-1b7c-488d-b8ee-6794883dd15e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:39.592338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-745c23f7-1b7c-488d-b8ee-6794883dd15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.604305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 906/1814] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:39.608319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c23f7-1b7c-488d-b8ee-6794883dd15e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.614694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bbbd7-86ac-48df-a23b-512396c34368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.616474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00bbbd7-86ac-48df-a23b-512396c34368 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.617645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c23f7-1b7c-488d-b8ee-6794883dd15e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:39.622570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174356c7-e2cb-4c7a-91cc-07a752bd31a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:39.623256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174356c7-e2cb-4c7a-91cc-07a752bd31a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.623545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174356c7-e2cb-4c7a-91cc-07a752bd31a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.623825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174356c7-e2cb-4c7a-91cc-07a752bd31a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.624552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174356c7-e2cb-4c7a-91cc-07a752bd31a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:39.624857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174356c7-e2cb-4c7a-91cc-07a752bd31a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.625726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 909/1815] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:31:39.626462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174356c7-e2cb-4c7a-91cc-07a752bd31a8 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.639700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 907/1816] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:31:39.643846 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bbbd7-86ac-48df-a23b-512396c34368 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.655477 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bbbd7-86ac-48df-a23b-512396c34368 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:39.660621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38046caa-55fd-4681-bb73-346c2c71baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:39.661146 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38046caa-55fd-4681-bb73-346c2c71baa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.661453 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38046caa-55fd-4681-bb73-346c2c71baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.661704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38046caa-55fd-4681-bb73-346c2c71baa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.662388 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38046caa-55fd-4681-bb73-346c2c71baa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.664349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38046caa-55fd-4681-bb73-346c2c71baa5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.689762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174356c7-e2cb-4c7a-91cc-07a752bd31a8 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.693013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-174356c7-e2cb-4c7a-91cc-07a752bd31a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.705165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 910/1817] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:39 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:39.706777 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38046caa-55fd-4681-bb73-346c2c71baa5 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.711547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174356c7-e2cb-4c7a-91cc-07a752bd31a8 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:39.787299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38046caa-55fd-4681-bb73-346c2c71baa5 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:39.790387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:39.791422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.791708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.792047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] PATH_INFO: `/v3/projects/25dba82031df4b04a81213933bddf78e` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.793649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ba201-a7be-499c-b36a-885a1735dc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:39.793774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=25dba82031df4b04a81213933bddf78e)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.793849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ba201-a7be-499c-b36a-885a1735dc9e admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.794074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ba201-a7be-499c-b36a-885a1735dc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.794355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ba201-a7be-499c-b36a-885a1735dc9e admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.795069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ba201-a7be-499c-b36a-885a1735dc9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.795390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.797510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ba201-a7be-499c-b36a-885a1735dc9e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.827731 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 911/1818] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:39 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:39.831068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ba201-a7be-499c-b36a-885a1735dc9e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.842825 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ba201-a7be-499c-b36a-885a1735dc9e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:39.858081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25dba82031df4b04a81213933bddf78e', 'request_id': 'req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:39.866316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25dba82031df4b04a81213933bddf78e', 'request_id': 'req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:39.872684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25dba82031df4b04a81213933bddf78e', 'request_id': 'req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:39.893567 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] The token cache is being invalidate because project 25dba82031df4b04a81213933bddf78e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:39.894158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:39.894922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-8dfc9304-5d1a-41ab-8341-4f89e29ab93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:39.899110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 908/1819] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:39 2022] DELETE /identity/v3/projects/25dba82031df4b04a81213933bddf78e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:39.901933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b0cbc-f73f-47d4-9b44-f64099fea545 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.902742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b0cbc-f73f-47d4-9b44-f64099fea545 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.903194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b0cbc-f73f-47d4-9b44-f64099fea545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.906553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded95da2-af8e-41eb-bd67-425e22d07e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:39.907346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded95da2-af8e-41eb-bd67-425e22d07e2b admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.907642 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded95da2-af8e-41eb-bd67-425e22d07e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.908217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded95da2-af8e-41eb-bd67-425e22d07e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.909115 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded95da2-af8e-41eb-bd67-425e22d07e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.910993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded95da2-af8e-41eb-bd67-425e22d07e2b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.928158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-9b2b0cbc-f73f-47d4-9b44-f64099fea545 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:39.929746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9b2b0cbc-f73f-47d4-9b44-f64099fea545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.932650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 912/1820] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:31:39.939141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded95da2-af8e-41eb-bd67-425e22d07e2b admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.939772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 909/1821] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:39.941074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-ded95da2-af8e-41eb-bd67-425e22d07e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.948363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd8d0-5871-4bd1-ab56-791c81e876c0 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.948733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd8d0-5871-4bd1-ab56-791c81e876c0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.949131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcd8d0-5871-4bd1-ab56-791c81e876c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.959332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded95da2-af8e-41eb-bd67-425e22d07e2b admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:39.966943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8eae3-9887-4744-bbe5-02dfffff6372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:39.967776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8eae3-9887-4744-bbe5-02dfffff6372 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:39.968367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8eae3-9887-4744-bbe5-02dfffff6372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:39.968650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8eae3-9887-4744-bbe5-02dfffff6372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:39.969388 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8eae3-9887-4744-bbe5-02dfffff6372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:39.971005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8eae3-9887-4744-bbe5-02dfffff6372 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:39.972689 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-0cfcd8d0-5871-4bd1-ab56-791c81e876c0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:39.974065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0cfcd8d0-5871-4bd1-ab56-791c81e876c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:39.983070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 913/1822] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:39.986237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8eae3-9887-4744-bbe5-02dfffff6372 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:39.986645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 910/1823] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:39.991521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcd8d0-5871-4bd1-ab56-791c81e876c0 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.003117 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfcd8d0-5871-4bd1-ab56-791c81e876c0 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.008875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c960a-0a0e-4151-bed6-84205ddb52f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.009556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c960a-0a0e-4151-bed6-84205ddb52f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.009844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c960a-0a0e-4151-bed6-84205ddb52f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.010125 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c960a-0a0e-4151-bed6-84205ddb52f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.010713 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8eae3-9887-4744-bbe5-02dfffff6372 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.010863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c960a-0a0e-4151-bed6-84205ddb52f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:40.011201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c960a-0a0e-4151-bed6-84205ddb52f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.013116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c960a-0a0e-4151-bed6-84205ddb52f4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.015922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4331b8-010f-4c75-abb0-0b901305b784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.016802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4331b8-010f-4c75-abb0-0b901305b784 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.017083 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4331b8-010f-4c75-abb0-0b901305b784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.017353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4331b8-010f-4c75-abb0-0b901305b784 admin admin] PATH_INFO: `/v3/projects/62d51d7c1ae4413ca28cae8e7d03b2f4/users/8505665b2a904ecb87024a6b714a0974/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.028193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 911/1824] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:40.032675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c960a-0a0e-4151-bed6-84205ddb52f4 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.034756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4331b8-010f-4c75-abb0-0b901305b784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d51d7c1ae4413ca28cae8e7d03b2f4, user_id=8505665b2a904ecb87024a6b714a0974, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.038473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4331b8-010f-4c75-abb0-0b901305b784 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.045304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c960a-0a0e-4151-bed6-84205ddb52f4 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.055386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 914/1825] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:39 2022] PUT /identity/v3/projects/62d51d7c1ae4413ca28cae8e7d03b2f4/users/8505665b2a904ecb87024a6b714a0974/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:40.066132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2a09b-3bb1-4033-bf07-d0e8d96b1a90 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.066504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2a09b-3bb1-4033-bf07-d0e8d96b1a90 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.067357 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2a09b-3bb1-4033-bf07-d0e8d96b1a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.095297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-00a2a09b-3bb1-4033-bf07-d0e8d96b1a90 None None] MFA Rules not processed for user `8505665b2a904ecb87024a6b714a0974`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:40.096691 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-00a2a09b-3bb1-4033-bf07-d0e8d96b1a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:40.112871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951c00c-7e87-43f0-9a32-c30731aad7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.114130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951c00c-7e87-43f0-9a32-c30731aad7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.114452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951c00c-7e87-43f0-9a32-c30731aad7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.114758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951c00c-7e87-43f0-9a32-c30731aad7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.115531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951c00c-7e87-43f0-9a32-c30731aad7c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.117620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951c00c-7e87-43f0-9a32-c30731aad7c5 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.171833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 912/1826] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:40 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:40.173024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951c00c-7e87-43f0-9a32-c30731aad7c5 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.180916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 915/1827] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:31:40.185970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2a09b-3bb1-4033-bf07-d0e8d96b1a90 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.197681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2a09b-3bb1-4033-bf07-d0e8d96b1a90 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.262150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133f5de-29c5-493a-a342-f39d38971fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.262847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133f5de-29c5-493a-a342-f39d38971fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.263213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133f5de-29c5-493a-a342-f39d38971fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.263497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133f5de-29c5-493a-a342-f39d38971fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.264275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133f5de-29c5-493a-a342-f39d38971fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.266288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133f5de-29c5-493a-a342-f39d38971fb7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.276816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951c00c-7e87-43f0-9a32-c30731aad7c5 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.284222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f05a02-49f8-4455-a368-d177961ba9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.286010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05a02-49f8-4455-a368-d177961ba9ec admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.286526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05a02-49f8-4455-a368-d177961ba9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.287393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f05a02-49f8-4455-a368-d177961ba9ec admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.288298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f05a02-49f8-4455-a368-d177961ba9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.290717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f05a02-49f8-4455-a368-d177961ba9ec admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.297705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 916/1828] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:40 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:40.309260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133f5de-29c5-493a-a342-f39d38971fb7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.319294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 913/1829] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:40 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:40.323960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f05a02-49f8-4455-a368-d177961ba9ec admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.345883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f05a02-49f8-4455-a368-d177961ba9ec admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.414279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133f5de-29c5-493a-a342-f39d38971fb7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.420215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3640e64-75e2-464d-be23-eb386e74501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.421196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3640e64-75e2-464d-be23-eb386e74501a admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.421719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3640e64-75e2-464d-be23-eb386e74501a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.422360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3640e64-75e2-464d-be23-eb386e74501a admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.423696 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3640e64-75e2-464d-be23-eb386e74501a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.426353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3640e64-75e2-464d-be23-eb386e74501a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.460919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 917/1830] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:40 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:40.466887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3640e64-75e2-464d-be23-eb386e74501a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.496329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3640e64-75e2-464d-be23-eb386e74501a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.498767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672e5fc-f8cf-43fe-a7f2-839ed1ad2458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.499511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672e5fc-f8cf-43fe-a7f2-839ed1ad2458 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.499799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672e5fc-f8cf-43fe-a7f2-839ed1ad2458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.500957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672e5fc-f8cf-43fe-a7f2-839ed1ad2458 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.501730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672e5fc-f8cf-43fe-a7f2-839ed1ad2458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.503759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672e5fc-f8cf-43fe-a7f2-839ed1ad2458 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.514501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168cba4-a6be-453a-87e4-7decf083fd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.515224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168cba4-a6be-453a-87e4-7decf083fd43 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.515355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 914/1831] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:40.517711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168cba4-a6be-453a-87e4-7decf083fd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.518042 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168cba4-a6be-453a-87e4-7decf083fd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.519286 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168cba4-a6be-453a-87e4-7decf083fd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.520586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672e5fc-f8cf-43fe-a7f2-839ed1ad2458 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.527170 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168cba4-a6be-453a-87e4-7decf083fd43 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.532658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672e5fc-f8cf-43fe-a7f2-839ed1ad2458 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.544865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b4a87-5535-4200-89f9-a28f1323e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.546362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b4a87-5535-4200-89f9-a28f1323e0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.546881 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b4a87-5535-4200-89f9-a28f1323e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.547822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b4a87-5535-4200-89f9-a28f1323e0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.548724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b4a87-5535-4200-89f9-a28f1323e0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.558913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 918/1832] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:40.559159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67b4a87-5535-4200-89f9-a28f1323e0b0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.563521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168cba4-a6be-453a-87e4-7decf083fd43 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.569800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 915/1833] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:31:40.575258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b4a87-5535-4200-89f9-a28f1323e0b0 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.578436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168cba4-a6be-453a-87e4-7decf083fd43 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.584070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8778aaf-020b-4fe7-80ec-eb3a3e47800c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.585069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8778aaf-020b-4fe7-80ec-eb3a3e47800c admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.585422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8778aaf-020b-4fe7-80ec-eb3a3e47800c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.585772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8778aaf-020b-4fe7-80ec-eb3a3e47800c admin admin] PATH_INFO: `/v3/projects/01bfb28e9ff043d3bad28167c7501305/users/ae551fbf16604ba7a05cc47359c915bd/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.589954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b4a87-5535-4200-89f9-a28f1323e0b0 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.597945 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4d1be-f951-4060-b476-77a2f4c91c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.599578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d1be-f951-4060-b476-77a2f4c91c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.605013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d1be-f951-4060-b476-77a2f4c91c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.605312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4d1be-f951-4060-b476-77a2f4c91c07 admin admin] PATH_INFO: `/v3/projects/a944839cc7cc44f4948a8e524ec4de55/users/b176021036e7461db389f34f342c6a52/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.623430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4d1be-f951-4060-b476-77a2f4c91c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a944839cc7cc44f4948a8e524ec4de55, user_id=b176021036e7461db389f34f342c6a52, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.626509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4d1be-f951-4060-b476-77a2f4c91c07 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.634058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8778aaf-020b-4fe7-80ec-eb3a3e47800c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bfb28e9ff043d3bad28167c7501305, user_id=ae551fbf16604ba7a05cc47359c915bd, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.636954 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8778aaf-020b-4fe7-80ec-eb3a3e47800c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.661522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 919/1834] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:40 2022] PUT /identity/v3/projects/01bfb28e9ff043d3bad28167c7501305/users/ae551fbf16604ba7a05cc47359c915bd/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:40.661895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 916/1835] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:40 2022] PUT /identity/v3/projects/a944839cc7cc44f4948a8e524ec4de55/users/b176021036e7461db389f34f342c6a52/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:40.670209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8778aaf-020b-4fe7-80ec-eb3a3e47800c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.671295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c097f7-19cf-41b4-ab95-58228d278f1c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.671816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c097f7-19cf-41b4-ab95-58228d278f1c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.672468 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c097f7-19cf-41b4-ab95-58228d278f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.706399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-15c097f7-19cf-41b4-ab95-58228d278f1c None None] MFA Rules not processed for user `b176021036e7461db389f34f342c6a52`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:40.708313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-15c097f7-19cf-41b4-ab95-58228d278f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:40.751582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8778aaf-020b-4fe7-80ec-eb3a3e47800c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.758582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990cbeb-74fc-4f19-9dce-b97f246e3746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.759293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990cbeb-74fc-4f19-9dce-b97f246e3746 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.759623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990cbeb-74fc-4f19-9dce-b97f246e3746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.759919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990cbeb-74fc-4f19-9dce-b97f246e3746 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.760667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990cbeb-74fc-4f19-9dce-b97f246e3746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.762307 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990cbeb-74fc-4f19-9dce-b97f246e3746 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.784390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 920/1836] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:40.785684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990cbeb-74fc-4f19-9dce-b97f246e3746 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.800524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990cbeb-74fc-4f19-9dce-b97f246e3746 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.806912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a0e90-06bc-4cdf-92e8-9a54289614c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.807932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a0e90-06bc-4cdf-92e8-9a54289614c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.808316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a0e90-06bc-4cdf-92e8-9a54289614c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.808595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a0e90-06bc-4cdf-92e8-9a54289614c5 admin admin] PATH_INFO: `/v3/projects/01bfb28e9ff043d3bad28167c7501305/users/ae551fbf16604ba7a05cc47359c915bd/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.809545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 917/1837] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:40.810640 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a0e90-06bc-4cdf-92e8-9a54289614c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bfb28e9ff043d3bad28167c7501305, user_id=ae551fbf16604ba7a05cc47359c915bd, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.813687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a0e90-06bc-4cdf-92e8-9a54289614c5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.813802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c097f7-19cf-41b4-ab95-58228d278f1c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.826958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 921/1838] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:40 2022] PUT /identity/v3/projects/01bfb28e9ff043d3bad28167c7501305/users/ae551fbf16604ba7a05cc47359c915bd/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:40.828371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c097f7-19cf-41b4-ab95-58228d278f1c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:40.839482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ccc2c-ad6e-4819-baa5-68d43bea99e1 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.839935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ccc2c-ad6e-4819-baa5-68d43bea99e1 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.840219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ccc2c-ad6e-4819-baa5-68d43bea99e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.874015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-fc0ccc2c-ad6e-4819-baa5-68d43bea99e1 None None] MFA Rules not processed for user `ae551fbf16604ba7a05cc47359c915bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:40.877276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-fc0ccc2c-ad6e-4819-baa5-68d43bea99e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:40.897860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17235c5a-ca5d-407e-8842-a4e3836abe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:40.898882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235c5a-ca5d-407e-8842-a4e3836abe19 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:40.899203 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235c5a-ca5d-407e-8842-a4e3836abe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:40.899558 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235c5a-ca5d-407e-8842-a4e3836abe19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:40.900453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17235c5a-ca5d-407e-8842-a4e3836abe19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:40.902396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17235c5a-ca5d-407e-8842-a4e3836abe19 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:40.956322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 918/1839] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:40 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:40.960228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17235c5a-ca5d-407e-8842-a4e3836abe19 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.967944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 922/1840] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:31:40.979306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ccc2c-ad6e-4819-baa5-68d43bea99e1 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:40.980736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-fc0ccc2c-ad6e-4819-baa5-68d43bea99e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:41.041557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17235c5a-ca5d-407e-8842-a4e3836abe19 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:41.046855 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a61abc-ef1d-4162-8068-90293d2c0edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:41.047543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61abc-ef1d-4162-8068-90293d2c0edf admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.047835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61abc-ef1d-4162-8068-90293d2c0edf admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.048115 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a61abc-ef1d-4162-8068-90293d2c0edf admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.048818 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a61abc-ef1d-4162-8068-90293d2c0edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:41.050912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a61abc-ef1d-4162-8068-90293d2c0edf admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:41.057414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ccc2c-ad6e-4819-baa5-68d43bea99e1 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:41.096183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 919/1841] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:40 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:41.096183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a61abc-ef1d-4162-8068-90293d2c0edf admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:41.120088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a61abc-ef1d-4162-8068-90293d2c0edf admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:41.126395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d7f56-23fe-4b3c-ad59-6ec0790a046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:41.127286 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d7f56-23fe-4b3c-ad59-6ec0790a046a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.127571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d7f56-23fe-4b3c-ad59-6ec0790a046a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.127850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d7f56-23fe-4b3c-ad59-6ec0790a046a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.128588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d7f56-23fe-4b3c-ad59-6ec0790a046a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:41.129665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1d55a-e17f-4f95-88c2-c579d97bd4db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:41.130539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d7f56-23fe-4b3c-ad59-6ec0790a046a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:41.130698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1d55a-e17f-4f95-88c2-c579d97bd4db service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.131157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1d55a-e17f-4f95-88c2-c579d97bd4db service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.131515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1d55a-e17f-4f95-88c2-c579d97bd4db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.142303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 920/1842] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:41.146317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d7f56-23fe-4b3c-ad59-6ec0790a046a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:41.158119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d7f56-23fe-4b3c-ad59-6ec0790a046a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:41.163661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191d90b-797d-4530-bf13-29ab5e50122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:41.164571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191d90b-797d-4530-bf13-29ab5e50122b admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.164864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191d90b-797d-4530-bf13-29ab5e50122b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.165533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191d90b-797d-4530-bf13-29ab5e50122b admin admin] PATH_INFO: `/v3/projects/77d0224dce8b49e49626a5e2ef3252aa/users/0ef57a899a53402591749ba89fe88114/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.188820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191d90b-797d-4530-bf13-29ab5e50122b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d0224dce8b49e49626a5e2ef3252aa, user_id=0ef57a899a53402591749ba89fe88114, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:41.192059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191d90b-797d-4530-bf13-29ab5e50122b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:41.209389 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1d55a-e17f-4f95-88c2-c579d97bd4db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:41.210892 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1d55a-e17f-4f95-88c2-c579d97bd4db service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:41.211363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 921/1843] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:41 2022] PUT /identity/v3/projects/77d0224dce8b49e49626a5e2ef3252aa/users/0ef57a899a53402591749ba89fe88114/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:41.215446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191d90b-797d-4530-bf13-29ab5e50122b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:41.222917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 923/1844] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:31:41.258433 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1d55a-e17f-4f95-88c2-c579d97bd4db service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:41.269302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1d55a-e17f-4f95-88c2-c579d97bd4db service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:41.291528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191d90b-797d-4530-bf13-29ab5e50122b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:41.296316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640ad5-38fe-4d49-ad02-f5244bdfbee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:41.297023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640ad5-38fe-4d49-ad02-f5244bdfbee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.297391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640ad5-38fe-4d49-ad02-f5244bdfbee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.297656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b640ad5-38fe-4d49-ad02-f5244bdfbee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.302219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b640ad5-38fe-4d49-ad02-f5244bdfbee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:41.302219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b640ad5-38fe-4d49-ad02-f5244bdfbee2 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:41.320149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 922/1845] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:31:41.324162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640ad5-38fe-4d49-ad02-f5244bdfbee2 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:41.335081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:41.335081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.335081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.335081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] PATH_INFO: `/v3/users/8505665b2a904ecb87024a6b714a0974` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.336515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8505665b2a904ecb87024a6b714a0974)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:41.338681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:41.345732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b640ad5-38fe-4d49-ad02-f5244bdfbee2 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:41.351522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4d610-6c51-46c8-8b7c-a40c5775f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:41.353138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d610-6c51-46c8-8b7c-a40c5775f523 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.353138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d610-6c51-46c8-8b7c-a40c5775f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.353311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4d610-6c51-46c8-8b7c-a40c5775f523 admin admin] PATH_INFO: `/v3/projects/77d0224dce8b49e49626a5e2ef3252aa/users/0ef57a899a53402591749ba89fe88114/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.355659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4d610-6c51-46c8-8b7c-a40c5775f523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d0224dce8b49e49626a5e2ef3252aa, user_id=0ef57a899a53402591749ba89fe88114, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:41.358353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4d610-6c51-46c8-8b7c-a40c5775f523 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:41.379933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 923/1846] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:41 2022] PUT /identity/v3/projects/77d0224dce8b49e49626a5e2ef3252aa/users/0ef57a899a53402591749ba89fe88114/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:41.382055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff9079-20af-4686-bf0c-dc0d6dde605d None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.382355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff9079-20af-4686-bf0c-dc0d6dde605d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.382715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff9079-20af-4686-bf0c-dc0d6dde605d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.406952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8505665b2a904ecb87024a6b714a0974'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:41.416240 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-57ff9079-20af-4686-bf0c-dc0d6dde605d None None] MFA Rules not processed for user `0ef57a899a53402591749ba89fe88114`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:41.417534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-57ff9079-20af-4686-bf0c-dc0d6dde605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:41.423261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8505665b2a904ecb87024a6b714a0974'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:41.424148 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8505665b2a904ecb87024a6b714a0974'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:41.424885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8505665b2a904ecb87024a6b714a0974'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:41.439361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-41206838-5dd7-45a4-835d-a77648e920d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8505665b2a904ecb87024a6b714a0974'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:41.453586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 924/1847] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:41 2022] DELETE /identity/v3/users/8505665b2a904ecb87024a6b714a0974 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:41.458582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da9feb-8844-4bfa-8516-65886e05607e None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.458903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da9feb-8844-4bfa-8516-65886e05607e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.459213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da9feb-8844-4bfa-8516-65886e05607e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.476933 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-98da9feb-8844-4bfa-8516-65886e05607e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:41.478171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-98da9feb-8844-4bfa-8516-65886e05607e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:41.497237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 924/1848] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:41.509311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff9079-20af-4686-bf0c-dc0d6dde605d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:41.510807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-57ff9079-20af-4686-bf0c-dc0d6dde605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:41.568343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 925/1849] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:31:41.575536 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff9079-20af-4686-bf0c-dc0d6dde605d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:41.578231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da9feb-8844-4bfa-8516-65886e05607e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:41.583253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-98da9feb-8844-4bfa-8516-65886e05607e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:41.674467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da9feb-8844-4bfa-8516-65886e05607e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:41.687311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ec4f1-c47a-415d-8520-06926628832b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:41.688281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ec4f1-c47a-415d-8520-06926628832b service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.688747 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ec4f1-c47a-415d-8520-06926628832b service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.689224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ec4f1-c47a-415d-8520-06926628832b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.710860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ec4f1-c47a-415d-8520-06926628832b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:41.712832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ec4f1-c47a-415d-8520-06926628832b service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:41.714653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700f712-4497-4c0e-a602-065b7448034f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:41.715606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700f712-4497-4c0e-a602-065b7448034f service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.715970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700f712-4497-4c0e-a602-065b7448034f service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.716315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700f712-4497-4c0e-a602-065b7448034f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.726514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 926/1850] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:31:41.728965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ec4f1-c47a-415d-8520-06926628832b service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:41.731551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f62ec4f1-c47a-415d-8520-06926628832b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:41.746841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ec4f1-c47a-415d-8520-06926628832b service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:41.752277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587eb0a-22ec-4f55-8740-cdf65c0138f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:41.753046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587eb0a-22ec-4f55-8740-cdf65c0138f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:41.753440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587eb0a-22ec-4f55-8740-cdf65c0138f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:41.753828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587eb0a-22ec-4f55-8740-cdf65c0138f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:41.757154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e587eb0a-22ec-4f55-8740-cdf65c0138f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:41.847322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700f712-4497-4c0e-a602-065b7448034f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:41.853921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700f712-4497-4c0e-a602-065b7448034f service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:41.891932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587eb0a-22ec-4f55-8740-cdf65c0138f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:41.893380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587eb0a-22ec-4f55-8740-cdf65c0138f7 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:41.897551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 925/1851] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:41.907165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 927/1852] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:42.083267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700f712-4497-4c0e-a602-065b7448034f service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:42.091564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700f712-4497-4c0e-a602-065b7448034f service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:42.098459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c9520-68e7-44e1-8e22-4a01f6cf78e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:42.098955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c9520-68e7-44e1-8e22-4a01f6cf78e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:42.099277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c9520-68e7-44e1-8e22-4a01f6cf78e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:42.101168 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c9520-68e7-44e1-8e22-4a01f6cf78e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:42.103684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-202c9520-68e7-44e1-8e22-4a01f6cf78e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:42.250205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587eb0a-22ec-4f55-8740-cdf65c0138f7 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:42.252344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e587eb0a-22ec-4f55-8740-cdf65c0138f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:42.252872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c9520-68e7-44e1-8e22-4a01f6cf78e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:42.255422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c9520-68e7-44e1-8e22-4a01f6cf78e1 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:42.268210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 926/1853] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:42.300574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587eb0a-22ec-4f55-8740-cdf65c0138f7 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:42.320105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:42.320995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:42.321274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:42.321546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] PATH_INFO: `/v3/projects/62d51d7c1ae4413ca28cae8e7d03b2f4` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:42.322874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d51d7c1ae4413ca28cae8e7d03b2f4)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:42.325135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:42.420756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d51d7c1ae4413ca28cae8e7d03b2f4', 'request_id': 'req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:42.441128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d51d7c1ae4413ca28cae8e7d03b2f4', 'request_id': 'req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:42.460106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d51d7c1ae4413ca28cae8e7d03b2f4', 'request_id': 'req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:42.486080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] The token cache is being invalidate because project 62d51d7c1ae4413ca28cae8e7d03b2f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:42.486520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:42.494822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:42.500525 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c9520-68e7-44e1-8e22-4a01f6cf78e1 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:42.502056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 928/1854] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:42 2022] DELETE /identity/v3/projects/62d51d7c1ae4413ca28cae8e7d03b2f4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:42.514545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c9520-68e7-44e1-8e22-4a01f6cf78e1 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:42.632574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:42.633844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:42.634181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:42.634574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] PATH_INFO: `/v3/users/ae551fbf16604ba7a05cc47359c915bd` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:42.648733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae551fbf16604ba7a05cc47359c915bd)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:42.655778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:42.746240 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae551fbf16604ba7a05cc47359c915bd'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:42.747393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae551fbf16604ba7a05cc47359c915bd'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:42.772132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae551fbf16604ba7a05cc47359c915bd'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:42.774362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae551fbf16604ba7a05cc47359c915bd'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:42.794354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-aa0e6c3b-29f4-487d-b4ea-2dc08b6795ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae551fbf16604ba7a05cc47359c915bd'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:42.848476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 927/1855] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:42 2022] DELETE /identity/v3/users/ae551fbf16604ba7a05cc47359c915bd => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:43.567672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:43.569239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:43.584175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f62df-c0e1-41bc-bdf0-5738c635a8aa admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:43.697129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:43.698174 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:43.698468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:43.698758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] PATH_INFO: `/v3/projects/01bfb28e9ff043d3bad28167c7501305` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:43.701601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bfb28e9ff043d3bad28167c7501305)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:43.703613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:43.844054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bfb28e9ff043d3bad28167c7501305', 'request_id': 'req-0ae011ea-3582-461d-ae50-2ade754d69ce'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:43.861662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bfb28e9ff043d3bad28167c7501305', 'request_id': 'req-0ae011ea-3582-461d-ae50-2ade754d69ce'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:43.873801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bfb28e9ff043d3bad28167c7501305', 'request_id': 'req-0ae011ea-3582-461d-ae50-2ade754d69ce'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:43.901258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] The token cache is being invalidate because project 01bfb28e9ff043d3bad28167c7501305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:43.901550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:43.903639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:43.919163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 929/1856] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:43 2022] DELETE /identity/v3/projects/01bfb28e9ff043d3bad28167c7501305 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:43.919478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e680d1-d43d-4c8d-90eb-273fb9739195 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:43.919478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e680d1-d43d-4c8d-90eb-273fb9739195 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:43.919478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e680d1-d43d-4c8d-90eb-273fb9739195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:43.947738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-72e680d1-d43d-4c8d-90eb-273fb9739195 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:43.949191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-72e680d1-d43d-4c8d-90eb-273fb9739195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:43.973670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:43.975320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:44.053708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 928/1857] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:31:44.064800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5a1f3-94f0-4c2d-b63a-617265e673ad None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.065132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5a1f3-94f0-4c2d-b63a-617265e673ad None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.065372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5a1f3-94f0-4c2d-b63a-617265e673ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.098806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5ee5a1f3-94f0-4c2d-b63a-617265e673ad None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:44.100209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5ee5a1f3-94f0-4c2d-b63a-617265e673ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:44.102289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae011ea-3582-461d-ae50-2ade754d69ce admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.107101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.108037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.108313 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.108677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 929/1858] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:44.111800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] PATH_INFO: `/v3/users/cd481618372840838cc771b81c99c0a6` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.112966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5a1f3-94f0-4c2d-b63a-617265e673ad None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.114010 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd481618372840838cc771b81c99c0a6)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.116004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.125350 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5a1f3-94f0-4c2d-b63a-617265e673ad None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.133817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e3b49-ef18-438b-b2e5-a1f75ef5e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.134568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e3b49-ef18-438b-b2e5-a1f75ef5e43a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.134914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e3b49-ef18-438b-b2e5-a1f75ef5e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.135315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e3b49-ef18-438b-b2e5-a1f75ef5e43a admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.136280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e3b49-ef18-438b-b2e5-a1f75ef5e43a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:44.136661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e3b49-ef18-438b-b2e5-a1f75ef5e43a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.139323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e3b49-ef18-438b-b2e5-a1f75ef5e43a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.151862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 930/1859] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:44.156621 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e3b49-ef18-438b-b2e5-a1f75ef5e43a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.169832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e3b49-ef18-438b-b2e5-a1f75ef5e43a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.181684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e84ef8-e476-41ba-a20a-211d2be41fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.183181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84ef8-e476-41ba-a20a-211d2be41fca admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.183181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84ef8-e476-41ba-a20a-211d2be41fca admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.183181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e84ef8-e476-41ba-a20a-211d2be41fca admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.183717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e84ef8-e476-41ba-a20a-211d2be41fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.185857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e84ef8-e476-41ba-a20a-211d2be41fca admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.187113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd481618372840838cc771b81c99c0a6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:44.196557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd481618372840838cc771b81c99c0a6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:44.197367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd481618372840838cc771b81c99c0a6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:44.198064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd481618372840838cc771b81c99c0a6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:44.215497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-15d04ccd-8eda-4178-8a48-8d29a0754e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd481618372840838cc771b81c99c0a6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:44.235214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 930/1860] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:43 2022] DELETE /identity/v3/users/cd481618372840838cc771b81c99c0a6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:44.242302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2afe3-d7a3-41af-a566-2dc7b67c5d55 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.242610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 931/1861] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:44 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:44.242719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2afe3-d7a3-41af-a566-2dc7b67c5d55 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.242719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2afe3-d7a3-41af-a566-2dc7b67c5d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.243762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e84ef8-e476-41ba-a20a-211d2be41fca admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.247645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-94e84ef8-e476-41ba-a20a-211d2be41fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:44.297011 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-28d2afe3-d7a3-41af-a566-2dc7b67c5d55 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:44.297011 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-28d2afe3-d7a3-41af-a566-2dc7b67c5d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:44.321706 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e84ef8-e476-41ba-a20a-211d2be41fca admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.327778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed452cf-857b-4802-9267-eaa74f418b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.328588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed452cf-857b-4802-9267-eaa74f418b0a admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.328900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed452cf-857b-4802-9267-eaa74f418b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.329314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed452cf-857b-4802-9267-eaa74f418b0a admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.330162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed452cf-857b-4802-9267-eaa74f418b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.332680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed452cf-857b-4802-9267-eaa74f418b0a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.362798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 932/1862] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:44 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:44.366803 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed452cf-857b-4802-9267-eaa74f418b0a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.382474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 931/1863] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:44.382733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed452cf-857b-4802-9267-eaa74f418b0a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.383109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240f32-2d0a-4814-aad0-0fc0a0dcd1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.383764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240f32-2d0a-4814-aad0-0fc0a0dcd1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.384070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240f32-2d0a-4814-aad0-0fc0a0dcd1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.384360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd240f32-2d0a-4814-aad0-0fc0a0dcd1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.385065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd240f32-2d0a-4814-aad0-0fc0a0dcd1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.386690 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd240f32-2d0a-4814-aad0-0fc0a0dcd1f2 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.390525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2afe3-d7a3-41af-a566-2dc7b67c5d55 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.392013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-28d2afe3-d7a3-41af-a566-2dc7b67c5d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:44.399483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 933/1864] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:44.403361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240f32-2d0a-4814-aad0-0fc0a0dcd1f2 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.414201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd240f32-2d0a-4814-aad0-0fc0a0dcd1f2 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.419128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245ce2-ffde-460f-86b1-0ba45ffff729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.419810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245ce2-ffde-460f-86b1-0ba45ffff729 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.420154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245ce2-ffde-460f-86b1-0ba45ffff729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.420635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245ce2-ffde-460f-86b1-0ba45ffff729 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.421358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64245ce2-ffde-460f-86b1-0ba45ffff729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.423073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64245ce2-ffde-460f-86b1-0ba45ffff729 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.435082 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 934/1865] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:31:44.437320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245ce2-ffde-460f-86b1-0ba45ffff729 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.447460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245ce2-ffde-460f-86b1-0ba45ffff729 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.452389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca3ae0-a6b5-4533-8c9b-c7ab4904ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.453337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca3ae0-a6b5-4533-8c9b-c7ab4904ecca admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.453682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca3ae0-a6b5-4533-8c9b-c7ab4904ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.453957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2afe3-d7a3-41af-a566-2dc7b67c5d55 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.454077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca3ae0-a6b5-4533-8c9b-c7ab4904ecca admin admin] PATH_INFO: `/v3/projects/a02c10d9657f40d1baa65cbbfe4f43e6/users/0d5982c2088d46b4b5a5fe17fce2abdb/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.458118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f3055-ebb6-4c16-8a64-cd8949f10756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.458912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f3055-ebb6-4c16-8a64-cd8949f10756 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.459236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f3055-ebb6-4c16-8a64-cd8949f10756 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.459510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f3055-ebb6-4c16-8a64-cd8949f10756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.469133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f3055-ebb6-4c16-8a64-cd8949f10756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.470161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca3ae0-a6b5-4533-8c9b-c7ab4904ecca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02c10d9657f40d1baa65cbbfe4f43e6, user_id=0d5982c2088d46b4b5a5fe17fce2abdb, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.470759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f3055-ebb6-4c16-8a64-cd8949f10756 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.473430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca3ae0-a6b5-4533-8c9b-c7ab4904ecca admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.481880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 932/1866] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:31:44.487345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 935/1867] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:44 2022] PUT /identity/v3/projects/a02c10d9657f40d1baa65cbbfe4f43e6/users/0d5982c2088d46b4b5a5fe17fce2abdb/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:44.498356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42ef96-93af-4e4c-b52b-3e067a913e6e None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.498645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42ef96-93af-4e4c-b52b-3e067a913e6e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.498921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42ef96-93af-4e4c-b52b-3e067a913e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.525135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6e42ef96-93af-4e4c-b52b-3e067a913e6e None None] MFA Rules not processed for user `0d5982c2088d46b4b5a5fe17fce2abdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:44.526344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6e42ef96-93af-4e4c-b52b-3e067a913e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:44.601943 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 933/1868] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:44.606415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca3ae0-a6b5-4533-8c9b-c7ab4904ecca admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.673409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca3ae0-a6b5-4533-8c9b-c7ab4904ecca admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.678823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f1c15-cbbf-44a6-9435-9674272bbdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.679531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f1c15-cbbf-44a6-9435-9674272bbdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.679810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f1c15-cbbf-44a6-9435-9674272bbdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.680085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f1c15-cbbf-44a6-9435-9674272bbdb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.680793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f1c15-cbbf-44a6-9435-9674272bbdb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.682697 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f1c15-cbbf-44a6-9435-9674272bbdb2 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.711692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 936/1869] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:44 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:44.712871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42ef96-93af-4e4c-b52b-3e067a913e6e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.724577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42ef96-93af-4e4c-b52b-3e067a913e6e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.792834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f17b3-f4fc-4521-9909-c4029c9ad2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.793532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f17b3-f4fc-4521-9909-c4029c9ad2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.793820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f17b3-f4fc-4521-9909-c4029c9ad2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.794097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f17b3-f4fc-4521-9909-c4029c9ad2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.794802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f17b3-f4fc-4521-9909-c4029c9ad2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.796801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f17b3-f4fc-4521-9909-c4029c9ad2f8 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.796984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f1c15-cbbf-44a6-9435-9674272bbdb2 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.798816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7b5f1c15-cbbf-44a6-9435-9674272bbdb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:44.815315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f1c15-cbbf-44a6-9435-9674272bbdb2 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.822272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 934/1870] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:44 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:44.823197 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.823422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f17b3-f4fc-4521-9909-c4029c9ad2f8 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.824895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.825198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.825495 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] PATH_INFO: `/v3/projects/a58364cd68cc490ba5ba5ccc7f267ae7` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.827128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58364cd68cc490ba5ba5ccc7f267ae7)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.829073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.833400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f17b3-f4fc-4521-9909-c4029c9ad2f8 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.838006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5508-41fb-4ba9-a923-34920b68323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.838661 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5508-41fb-4ba9-a923-34920b68323f admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.838945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5508-41fb-4ba9-a923-34920b68323f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.839251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5508-41fb-4ba9-a923-34920b68323f admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.839980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5508-41fb-4ba9-a923-34920b68323f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.841579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5508-41fb-4ba9-a923-34920b68323f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.853565 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 935/1871] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:31:44.857607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5508-41fb-4ba9-a923-34920b68323f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.868523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5508-41fb-4ba9-a923-34920b68323f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:44.880498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58364cd68cc490ba5ba5ccc7f267ae7', 'request_id': 'req-02f92101-c0e7-429b-b9e0-e81092325fe3'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:44.887385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58364cd68cc490ba5ba5ccc7f267ae7', 'request_id': 'req-02f92101-c0e7-429b-b9e0-e81092325fe3'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:44.892902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58364cd68cc490ba5ba5ccc7f267ae7', 'request_id': 'req-02f92101-c0e7-429b-b9e0-e81092325fe3'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:44.905380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] The token cache is being invalidate because project a58364cd68cc490ba5ba5ccc7f267ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:44.905649 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:44.906294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:44.907917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 937/1872] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:44 2022] DELETE /identity/v3/projects/a58364cd68cc490ba5ba5ccc7f267ae7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:44.912358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.913768 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:44.935777 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db37dd-0b79-4a9b-bbd3-48acdf8328f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:44.936726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db37dd-0b79-4a9b-bbd3-48acdf8328f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:44.937009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db37dd-0b79-4a9b-bbd3-48acdf8328f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:44.937344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db37dd-0b79-4a9b-bbd3-48acdf8328f8 admin admin] PATH_INFO: `/v3/projects/92c331ee69394c28839e6ef64fd5b005/users/5859df074699419db9e6b69fd3a48e5c/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:44.957623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db37dd-0b79-4a9b-bbd3-48acdf8328f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c331ee69394c28839e6ef64fd5b005, user_id=5859df074699419db9e6b69fd3a48e5c, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:44.960471 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db37dd-0b79-4a9b-bbd3-48acdf8328f8 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:44.990227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 936/1873] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:44 2022] PUT /identity/v3/projects/92c331ee69394c28839e6ef64fd5b005/users/5859df074699419db9e6b69fd3a48e5c/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:44.992892 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db37dd-0b79-4a9b-bbd3-48acdf8328f8 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:44.996408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-53db37dd-0b79-4a9b-bbd3-48acdf8328f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:45.012345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f92101-c0e7-429b-b9e0-e81092325fe3 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:45.069696 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:45.070573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.070857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.071230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] PATH_INFO: `/v3/users/3c64a0e117b54a66869053475e343996` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.072432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c64a0e117b54a66869053475e343996)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:45.074394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:45.074679 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db37dd-0b79-4a9b-bbd3-48acdf8328f8 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:45.079491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcfc3a-13d4-477e-a7a6-e982276e0108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:45.080158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfc3a-13d4-477e-a7a6-e982276e0108 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.080443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfc3a-13d4-477e-a7a6-e982276e0108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.080721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afcfc3a-13d4-477e-a7a6-e982276e0108 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.081452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcfc3a-13d4-477e-a7a6-e982276e0108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:45.083095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afcfc3a-13d4-477e-a7a6-e982276e0108 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:45.093230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 937/1874] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:45.097714 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcfc3a-13d4-477e-a7a6-e982276e0108 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:45.107769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afcfc3a-13d4-477e-a7a6-e982276e0108 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:45.112415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91eb828-74b1-40d7-9574-3fe5ff6d0521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:45.113279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb828-74b1-40d7-9574-3fe5ff6d0521 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.114082 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb828-74b1-40d7-9574-3fe5ff6d0521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.114355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91eb828-74b1-40d7-9574-3fe5ff6d0521 admin admin] PATH_INFO: `/v3/projects/92c331ee69394c28839e6ef64fd5b005/users/5859df074699419db9e6b69fd3a48e5c/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.116316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eb828-74b1-40d7-9574-3fe5ff6d0521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c331ee69394c28839e6ef64fd5b005, user_id=5859df074699419db9e6b69fd3a48e5c, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:45.119236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91eb828-74b1-40d7-9574-3fe5ff6d0521 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:45.119747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c64a0e117b54a66869053475e343996'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:45.120419 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c64a0e117b54a66869053475e343996'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:45.127609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c64a0e117b54a66869053475e343996'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:45.128259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c64a0e117b54a66869053475e343996'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:45.129935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 938/1875] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:45 2022] PUT /identity/v3/projects/92c331ee69394c28839e6ef64fd5b005/users/5859df074699419db9e6b69fd3a48e5c/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:45.136282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c64a0e117b54a66869053475e343996'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:45.140490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179b7bf-72d4-46ad-a15a-04b54dd84596 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.140836 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179b7bf-72d4-46ad-a15a-04b54dd84596 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.141066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179b7bf-72d4-46ad-a15a-04b54dd84596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.153321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 938/1876] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:44 2022] DELETE /identity/v3/users/3c64a0e117b54a66869053475e343996 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:45.167012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-9179b7bf-72d4-46ad-a15a-04b54dd84596 None None] MFA Rules not processed for user `5859df074699419db9e6b69fd3a48e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:45.168271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9179b7bf-72d4-46ad-a15a-04b54dd84596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:45.238974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 939/1877] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:45.258756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:45.260347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:45.320647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1c72e-31a9-4bec-9932-ecbe34dd9a57 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:45.327243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625a3c6-54c5-4e7a-b0f2-ac1779986836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:45.327913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625a3c6-54c5-4e7a-b0f2-ac1779986836 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.328199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625a3c6-54c5-4e7a-b0f2-ac1779986836 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.328473 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625a3c6-54c5-4e7a-b0f2-ac1779986836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.340970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625a3c6-54c5-4e7a-b0f2-ac1779986836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:45.343182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625a3c6-54c5-4e7a-b0f2-ac1779986836 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:45.364647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 939/1878] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:45.484356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179b7bf-72d4-46ad-a15a-04b54dd84596 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:45.486716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9179b7bf-72d4-46ad-a15a-04b54dd84596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:45.562667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179b7bf-72d4-46ad-a15a-04b54dd84596 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:45.567766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:45.568634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.568916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.569196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] PATH_INFO: `/v3/projects/2e34396c619d4117b04068943653c2c3` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.570451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e34396c619d4117b04068943653c2c3)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:45.572499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:45.624589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e34396c619d4117b04068943653c2c3', 'request_id': 'req-7466c1cb-a450-4270-bc4f-8be5db8e81fb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:45.636064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e34396c619d4117b04068943653c2c3', 'request_id': 'req-7466c1cb-a450-4270-bc4f-8be5db8e81fb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:45.644328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e34396c619d4117b04068943653c2c3', 'request_id': 'req-7466c1cb-a450-4270-bc4f-8be5db8e81fb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:45.660347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] The token cache is being invalidate because project 2e34396c619d4117b04068943653c2c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:45.660724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:45.663288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-7466c1cb-a450-4270-bc4f-8be5db8e81fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:45.663288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 940/1879] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:45 2022] DELETE /identity/v3/projects/2e34396c619d4117b04068943653c2c3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:45.668341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad7f9-7ce7-4dda-b55d-1f3fdb4fc801 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.668634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad7f9-7ce7-4dda-b55d-1f3fdb4fc801 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.668920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad7f9-7ce7-4dda-b55d-1f3fdb4fc801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.687566 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-964ad7f9-7ce7-4dda-b55d-1f3fdb4fc801 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:45.688837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-964ad7f9-7ce7-4dda-b55d-1f3fdb4fc801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:45.760633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 940/1880] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:45.769317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ad7f9-7ce7-4dda-b55d-1f3fdb4fc801 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:45.770783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-964ad7f9-7ce7-4dda-b55d-1f3fdb4fc801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:45.771059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2a70-55de-4748-888f-5f109f10daae None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.771770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2a70-55de-4748-888f-5f109f10daae None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.772526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d2a70-55de-4748-888f-5f109f10daae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.802980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-3c3d2a70-55de-4748-888f-5f109f10daae None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:45.804262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3c3d2a70-55de-4748-888f-5f109f10daae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:45.815843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 941/1881] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:45.817215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2a70-55de-4748-888f-5f109f10daae None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:45.826399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d2a70-55de-4748-888f-5f109f10daae None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:45.831445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4555-1f26-41cb-b734-01c14b70287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:45.832255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4555-1f26-41cb-b734-01c14b70287b admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.832538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4555-1f26-41cb-b734-01c14b70287b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.832811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f4555-1f26-41cb-b734-01c14b70287b admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.833537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4555-1f26-41cb-b734-01c14b70287b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:45.833841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4555-1f26-41cb-b734-01c14b70287b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:45.835505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f4555-1f26-41cb-b734-01c14b70287b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:45.842998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ad7f9-7ce7-4dda-b55d-1f3fdb4fc801 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:45.847851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 942/1882] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:45.847999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86d4a7-79fb-4ce4-94e2-0354961dd2d3 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5859df074699419db9e6b69fd3a48e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c331ee69394c28839e6ef64fd5b005', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:45.848633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86d4a7-79fb-4ce4-94e2-0354961dd2d3 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.848921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86d4a7-79fb-4ce4-94e2-0354961dd2d3 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.849227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86d4a7-79fb-4ce4-94e2-0354961dd2d3 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.849968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86d4a7-79fb-4ce4-94e2-0354961dd2d3 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:45.850282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86d4a7-79fb-4ce4-94e2-0354961dd2d3 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:45.851931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86d4a7-79fb-4ce4-94e2-0354961dd2d3 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:45.852158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4555-1f26-41cb-b734-01c14b70287b admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:45.862270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f4555-1f26-41cb-b734-01c14b70287b admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:45.863960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 941/1883] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:31:45.867996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645e6ba-27d1-448b-b184-7def80858121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:45.868198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86d4a7-79fb-4ce4-94e2-0354961dd2d3 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:45.868654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645e6ba-27d1-448b-b184-7def80858121 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.868946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645e6ba-27d1-448b-b184-7def80858121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.869227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645e6ba-27d1-448b-b184-7def80858121 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.869919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645e6ba-27d1-448b-b184-7def80858121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:45.871941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645e6ba-27d1-448b-b184-7def80858121 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:45.877631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86d4a7-79fb-4ce4-94e2-0354961dd2d3 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:45.883161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5abfaf-25b9-4955-a33a-f43607be7ba9 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5859df074699419db9e6b69fd3a48e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c331ee69394c28839e6ef64fd5b005', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:45.883844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5abfaf-25b9-4955-a33a-f43607be7ba9 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:45.884095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5abfaf-25b9-4955-a33a-f43607be7ba9 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:45.884373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5abfaf-25b9-4955-a33a-f43607be7ba9 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:45.885055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5abfaf-25b9-4955-a33a-f43607be7ba9 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:45.886942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5abfaf-25b9-4955-a33a-f43607be7ba9 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:45.898331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 943/1884] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:45 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:45.902544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645e6ba-27d1-448b-b184-7def80858121 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:45.914844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 942/1885] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:45 2022] POST /identity/v3/projects => generated 353 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:45.918929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5abfaf-25b9-4955-a33a-f43607be7ba9 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:45.972177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645e6ba-27d1-448b-b184-7def80858121 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.027326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5abfaf-25b9-4955-a33a-f43607be7ba9 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.032447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a184605-0b8d-41a9-adbc-8389914255de tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5859df074699419db9e6b69fd3a48e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c331ee69394c28839e6ef64fd5b005', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.033084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a184605-0b8d-41a9-adbc-8389914255de tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.033442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a184605-0b8d-41a9-adbc-8389914255de tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.033736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a184605-0b8d-41a9-adbc-8389914255de tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.034567 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a184605-0b8d-41a9-adbc-8389914255de tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:46.034815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a184605-0b8d-41a9-adbc-8389914255de tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.036449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a184605-0b8d-41a9-adbc-8389914255de tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.038540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5d29e-f697-4ca7-817c-dd383faf7624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.039260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d29e-f697-4ca7-817c-dd383faf7624 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.039547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d29e-f697-4ca7-817c-dd383faf7624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.039828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d29e-f697-4ca7-817c-dd383faf7624 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.042458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5d29e-f697-4ca7-817c-dd383faf7624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.042458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5d29e-f697-4ca7-817c-dd383faf7624 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.051344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 943/1886] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:46.075408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 944/1887] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:45 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:46.079965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a184605-0b8d-41a9-adbc-8389914255de tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.092346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a184605-0b8d-41a9-adbc-8389914255de tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.100510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416733-46d6-483a-971b-94d3bafb12e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.101225 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416733-46d6-483a-971b-94d3bafb12e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.101512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416733-46d6-483a-971b-94d3bafb12e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.101790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae416733-46d6-483a-971b-94d3bafb12e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.102585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae416733-46d6-483a-971b-94d3bafb12e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.104228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae416733-46d6-483a-971b-94d3bafb12e5 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.109080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5d29e-f697-4ca7-817c-dd383faf7624 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.120725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 944/1888] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:46.120725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416733-46d6-483a-971b-94d3bafb12e5 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.121955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5d29e-f697-4ca7-817c-dd383faf7624 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.129192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5859df074699419db9e6b69fd3a48e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92c331ee69394c28839e6ef64fd5b005', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.130296 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.130594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.130708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae416733-46d6-483a-971b-94d3bafb12e5 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.130876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] PATH_INFO: `/v3/projects/b6bba048a578441e92911759f982236b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.132455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b6bba048a578441e92911759f982236b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.134422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.136033 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046faad-7838-445e-8f05-a65da0b3b99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.136784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046faad-7838-445e-8f05-a65da0b3b99a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.137144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046faad-7838-445e-8f05-a65da0b3b99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.137501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046faad-7838-445e-8f05-a65da0b3b99a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.138323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046faad-7838-445e-8f05-a65da0b3b99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.140026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046faad-7838-445e-8f05-a65da0b3b99a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.153576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 945/1889] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:31:46.157720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046faad-7838-445e-8f05-a65da0b3b99a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.168449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046faad-7838-445e-8f05-a65da0b3b99a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.173213 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5039a6-7cff-4f78-bd84-f73721e25509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.174087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5039a6-7cff-4f78-bd84-f73721e25509 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.174388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5039a6-7cff-4f78-bd84-f73721e25509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.174667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5039a6-7cff-4f78-bd84-f73721e25509 admin admin] PATH_INFO: `/v3/projects/4689a907d5654c58aed805c453a20833/users/c4b8a6ebc6fa41818678eacb8b80bffc/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.185794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bba048a578441e92911759f982236b', 'request_id': 'req-890a5445-0a2d-45f7-af6d-b673ecf329c4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:46.189467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5039a6-7cff-4f78-bd84-f73721e25509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4689a907d5654c58aed805c453a20833, user_id=c4b8a6ebc6fa41818678eacb8b80bffc, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.192850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5039a6-7cff-4f78-bd84-f73721e25509 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.194332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bba048a578441e92911759f982236b', 'request_id': 'req-890a5445-0a2d-45f7-af6d-b673ecf329c4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:46.200428 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bba048a578441e92911759f982236b', 'request_id': 'req-890a5445-0a2d-45f7-af6d-b673ecf329c4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:46.207994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 946/1890] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:46 2022] PUT /identity/v3/projects/4689a907d5654c58aed805c453a20833/users/c4b8a6ebc6fa41818678eacb8b80bffc/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:46.213581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] The token cache is being invalidate because project b6bba048a578441e92911759f982236b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:46.213872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:46.214542 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:46.216124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 945/1891] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:46 2022] DELETE /identity/v3/projects/b6bba048a578441e92911759f982236b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:46.218346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81d1ee-7462-4ce3-9b2c-69b0bfa72ea3 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.218641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81d1ee-7462-4ce3-9b2c-69b0bfa72ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.218923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81d1ee-7462-4ce3-9b2c-69b0bfa72ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.246881 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-4a81d1ee-7462-4ce3-9b2c-69b0bfa72ea3 None None] MFA Rules not processed for user `c4b8a6ebc6fa41818678eacb8b80bffc`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:46.248075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4a81d1ee-7462-4ce3-9b2c-69b0bfa72ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:46.318181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 947/1892] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:46.323336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.324914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:46.395427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a5445-0a2d-45f7-af6d-b673ecf329c4 tempest-VolumeQuotaClassesTest-876295836 tempest-VolumeQuotaClassesTest-876295836-project-admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.441147 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81d1ee-7462-4ce3-9b2c-69b0bfa72ea3 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.442677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4a81d1ee-7462-4ce3-9b2c-69b0bfa72ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:46.471626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ed759-89b4-415b-97ea-385ef1ddbfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.472413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ed759-89b4-415b-97ea-385ef1ddbfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.473404 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ed759-89b4-415b-97ea-385ef1ddbfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.473904 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ed759-89b4-415b-97ea-385ef1ddbfb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.474729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ed759-89b4-415b-97ea-385ef1ddbfb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.476734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ed759-89b4-415b-97ea-385ef1ddbfb8 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.507484 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 946/1893] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:46 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:46.508614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ed759-89b4-415b-97ea-385ef1ddbfb8 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.515194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81d1ee-7462-4ce3-9b2c-69b0bfa72ea3 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.576198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.577084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.577513 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.577797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] PATH_INFO: `/v3/users/0d5982c2088d46b4b5a5fe17fce2abdb` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.579053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5982c2088d46b4b5a5fe17fce2abdb)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.581078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.582660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ed759-89b4-415b-97ea-385ef1ddbfb8 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.587853 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d714d-9272-41c9-bf25-d9dc4d5b1b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.588523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d714d-9272-41c9-bf25-d9dc4d5b1b6b admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.588812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d714d-9272-41c9-bf25-d9dc4d5b1b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.589094 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d714d-9272-41c9-bf25-d9dc4d5b1b6b admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.589791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d714d-9272-41c9-bf25-d9dc4d5b1b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.591760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d714d-9272-41c9-bf25-d9dc4d5b1b6b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.616401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 947/1894] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:46 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:46.620391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d714d-9272-41c9-bf25-d9dc4d5b1b6b admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.630338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5982c2088d46b4b5a5fe17fce2abdb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:46.630515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d714d-9272-41c9-bf25-d9dc4d5b1b6b admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.631013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5982c2088d46b4b5a5fe17fce2abdb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:46.635429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5893a-0ce5-45dd-92a5-929c5ccdc5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.636076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5893a-0ce5-45dd-92a5-929c5ccdc5fa admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.636360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5893a-0ce5-45dd-92a5-929c5ccdc5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.636633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5893a-0ce5-45dd-92a5-929c5ccdc5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.637352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5893a-0ce5-45dd-92a5-929c5ccdc5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.638256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5982c2088d46b4b5a5fe17fce2abdb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:46.638907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5982c2088d46b4b5a5fe17fce2abdb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:46.639121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5893a-0ce5-45dd-92a5-929c5ccdc5fa admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.646531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-dab834c5-929d-47fa-a44e-8990dfb02ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5982c2088d46b4b5a5fe17fce2abdb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:46.651066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 948/1895] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:31:46.654835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5893a-0ce5-45dd-92a5-929c5ccdc5fa admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.656613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-22d5893a-0ce5-45dd-92a5-929c5ccdc5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:46.666548 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 948/1896] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:46 2022] DELETE /identity/v3/users/0d5982c2088d46b4b5a5fe17fce2abdb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:46.670397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5893a-0ce5-45dd-92a5-929c5ccdc5fa admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.670694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2b08c-adcc-4c10-8c51-ec9ce00cabd4 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.670984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2b08c-adcc-4c10-8c51-ec9ce00cabd4 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.671333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2b08c-adcc-4c10-8c51-ec9ce00cabd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.688150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-46f2b08c-adcc-4c10-8c51-ec9ce00cabd4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:46.689369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-46f2b08c-adcc-4c10-8c51-ec9ce00cabd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:46.725828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cc31a-ada0-41f0-aa31-eba772b61344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.726719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cc31a-ada0-41f0-aa31-eba772b61344 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.726999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cc31a-ada0-41f0-aa31-eba772b61344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.727301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69cc31a-ada0-41f0-aa31-eba772b61344 admin admin] PATH_INFO: `/v3/projects/3b86f32a05bd4c7c9070dfe0cdaf22ee/users/992e61ba527f446cac134866c8d20fb9/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.741338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cc31a-ada0-41f0-aa31-eba772b61344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b86f32a05bd4c7c9070dfe0cdaf22ee, user_id=992e61ba527f446cac134866c8d20fb9, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.744087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69cc31a-ada0-41f0-aa31-eba772b61344 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.747586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 949/1897] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:31:46.758226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2b08c-adcc-4c10-8c51-ec9ce00cabd4 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.759616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-46f2b08c-adcc-4c10-8c51-ec9ce00cabd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:46.761953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 949/1898] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:46 2022] PUT /identity/v3/projects/3b86f32a05bd4c7c9070dfe0cdaf22ee/users/992e61ba527f446cac134866c8d20fb9/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:46.766329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cc31a-ada0-41f0-aa31-eba772b61344 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.815737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2b08c-adcc-4c10-8c51-ec9ce00cabd4 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.828413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69cc31a-ada0-41f0-aa31-eba772b61344 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.834674 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db6f80-c6cf-4d1f-9881-d7e173f4fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.835461 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6f80-c6cf-4d1f-9881-d7e173f4fdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.835846 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6f80-c6cf-4d1f-9881-d7e173f4fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.836191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db6f80-c6cf-4d1f-9881-d7e173f4fdf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.836997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db6f80-c6cf-4d1f-9881-d7e173f4fdf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.838683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db6f80-c6cf-4d1f-9881-d7e173f4fdf6 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.848836 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 950/1899] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:31:46.855986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db6f80-c6cf-4d1f-9881-d7e173f4fdf6 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:46.866585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db6f80-c6cf-4d1f-9881-d7e173f4fdf6 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:46.867491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc266426-f0b0-4e7a-b7b5-1a4920d09e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.868229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc266426-f0b0-4e7a-b7b5-1a4920d09e3d service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.869170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc266426-f0b0-4e7a-b7b5-1a4920d09e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.869533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc266426-f0b0-4e7a-b7b5-1a4920d09e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.871772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207392c-d9ec-44d5-8aff-b896688d837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:46.872725 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207392c-d9ec-44d5-8aff-b896688d837b admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.873088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207392c-d9ec-44d5-8aff-b896688d837b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.873371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207392c-d9ec-44d5-8aff-b896688d837b admin admin] PATH_INFO: `/v3/projects/3b86f32a05bd4c7c9070dfe0cdaf22ee/users/992e61ba527f446cac134866c8d20fb9/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.875671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207392c-d9ec-44d5-8aff-b896688d837b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b86f32a05bd4c7c9070dfe0cdaf22ee, user_id=992e61ba527f446cac134866c8d20fb9, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.878341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207392c-d9ec-44d5-8aff-b896688d837b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.880234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc266426-f0b0-4e7a-b7b5-1a4920d09e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:46.881932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc266426-f0b0-4e7a-b7b5-1a4920d09e3d service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:46.891205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 951/1900] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:46 2022] PUT /identity/v3/projects/3b86f32a05bd4c7c9070dfe0cdaf22ee/users/992e61ba527f446cac134866c8d20fb9/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:46.891877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 950/1901] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:31:46.902596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f859c-52ae-43da-b6e1-413e908a0d7c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:46.902887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f859c-52ae-43da-b6e1-413e908a0d7c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:46.903202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f859c-52ae-43da-b6e1-413e908a0d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:46.931212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-272f859c-52ae-43da-b6e1-413e908a0d7c None None] MFA Rules not processed for user `992e61ba527f446cac134866c8d20fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:46.932461 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-272f859c-52ae-43da-b6e1-413e908a0d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:47.015139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 952/1902] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:47.028043 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc266426-f0b0-4e7a-b7b5-1a4920d09e3d service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:47.029524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cc266426-f0b0-4e7a-b7b5-1a4920d09e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:47.096611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc266426-f0b0-4e7a-b7b5-1a4920d09e3d service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:47.148816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c67221-6b8f-4f57-bff1-9b5b40f16ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:47.149432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c67221-6b8f-4f57-bff1-9b5b40f16ccb service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:47.149720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c67221-6b8f-4f57-bff1-9b5b40f16ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:47.149998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c67221-6b8f-4f57-bff1-9b5b40f16ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:47.160728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c67221-6b8f-4f57-bff1-9b5b40f16ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:47.162484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c67221-6b8f-4f57-bff1-9b5b40f16ccb service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:47.173463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 951/1903] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:31:47.217774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f859c-52ae-43da-b6e1-413e908a0d7c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:47.219763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-272f859c-52ae-43da-b6e1-413e908a0d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:47.293388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c67221-6b8f-4f57-bff1-9b5b40f16ccb service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:47.302361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c67221-6b8f-4f57-bff1-9b5b40f16ccb service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:47.305253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f859c-52ae-43da-b6e1-413e908a0d7c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:47.305972 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659f201-2841-4b66-b3de-7a39a7e0391f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:47.306609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659f201-2841-4b66-b3de-7a39a7e0391f service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:47.306892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659f201-2841-4b66-b3de-7a39a7e0391f service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:47.307217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659f201-2841-4b66-b3de-7a39a7e0391f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:47.309075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7659f201-2841-4b66-b3de-7a39a7e0391f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:47.309781 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:47.310639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:47.310924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:47.311227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] PATH_INFO: `/v3/projects/a02c10d9657f40d1baa65cbbfe4f43e6` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:47.312450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02c10d9657f40d1baa65cbbfe4f43e6)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:47.314378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:47.364252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02c10d9657f40d1baa65cbbfe4f43e6', 'request_id': 'req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:47.375501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02c10d9657f40d1baa65cbbfe4f43e6', 'request_id': 'req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:47.380403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659f201-2841-4b66-b3de-7a39a7e0391f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:47.382324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02c10d9657f40d1baa65cbbfe4f43e6', 'request_id': 'req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:47.383470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659f201-2841-4b66-b3de-7a39a7e0391f service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:47.393540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] The token cache is being invalidate because project a02c10d9657f40d1baa65cbbfe4f43e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:47.393825 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:47.394495 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:47.396192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 953/1904] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:47 2022] DELETE /identity/v3/projects/a02c10d9657f40d1baa65cbbfe4f43e6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:47.400118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 952/1905] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:31:47.400554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:47.401912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:47.467017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a8c83-c9a8-4762-b3f0-e29ebef5312e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:47.471889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:47.472770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:47.473059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:47.473338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] PATH_INFO: `/v3/users/5859df074699419db9e6b69fd3a48e5c` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:47.474546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5859df074699419db9e6b69fd3a48e5c)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:47.476582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:47.534841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5859df074699419db9e6b69fd3a48e5c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:47.542002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5859df074699419db9e6b69fd3a48e5c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:47.542727 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5859df074699419db9e6b69fd3a48e5c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:47.543373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5859df074699419db9e6b69fd3a48e5c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:47.555865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a8820808-45eb-4c76-b1bb-88d9a5e6555d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5859df074699419db9e6b69fd3a48e5c'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:47.572559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 954/1906] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:31:47 2022] DELETE /identity/v3/users/5859df074699419db9e6b69fd3a48e5c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:47.878932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659f201-2841-4b66-b3de-7a39a7e0391f service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:47.890066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659f201-2841-4b66-b3de-7a39a7e0391f service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:47.946893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:47.947932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:47.948219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:47.948501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] PATH_INFO: `/v3/projects/92c331ee69394c28839e6ef64fd5b005` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:47.949696 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c331ee69394c28839e6ef64fd5b005)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:47.951691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:47.999999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c331ee69394c28839e6ef64fd5b005', 'request_id': 'req-83eacb54-980c-419f-a2ae-819c0735e68c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:48.006067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c331ee69394c28839e6ef64fd5b005', 'request_id': 'req-83eacb54-980c-419f-a2ae-819c0735e68c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:48.012027 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c331ee69394c28839e6ef64fd5b005', 'request_id': 'req-83eacb54-980c-419f-a2ae-819c0735e68c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:48.024991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] The token cache is being invalidate because project 92c331ee69394c28839e6ef64fd5b005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:31:48.025281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:48.025909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-83eacb54-980c-419f-a2ae-819c0735e68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:31:48.027653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 953/1907] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:31:47 2022] DELETE /identity/v3/projects/92c331ee69394c28839e6ef64fd5b005 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:48.032934 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e902fa-6ed7-48b1-bde2-1a2c13ac382f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.033448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e902fa-6ed7-48b1-bde2-1a2c13ac382f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.033674 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e902fa-6ed7-48b1-bde2-1a2c13ac382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.051726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c4e902fa-6ed7-48b1-bde2-1a2c13ac382f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:48.053178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c4e902fa-6ed7-48b1-bde2-1a2c13ac382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:48.115808 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 955/1908] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:48.123462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745666c6-54d0-4bab-9658-470844837df6 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.123951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745666c6-54d0-4bab-9658-470844837df6 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.124026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745666c6-54d0-4bab-9658-470844837df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.142128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-745666c6-54d0-4bab-9658-470844837df6 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:48.143383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-745666c6-54d0-4bab-9658-470844837df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:48.152093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 954/1909] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:48.156392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e902fa-6ed7-48b1-bde2-1a2c13ac382f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.166675 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e902fa-6ed7-48b1-bde2-1a2c13ac382f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.171304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31081e9b-368a-4bb2-aa28-0a29ee7c632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.171960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31081e9b-368a-4bb2-aa28-0a29ee7c632e admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.172248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31081e9b-368a-4bb2-aa28-0a29ee7c632e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.172527 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31081e9b-368a-4bb2-aa28-0a29ee7c632e admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.173255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31081e9b-368a-4bb2-aa28-0a29ee7c632e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:31:48.173563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31081e9b-368a-4bb2-aa28-0a29ee7c632e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.175207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31081e9b-368a-4bb2-aa28-0a29ee7c632e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.186224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 956/1910] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:31:48.190511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745666c6-54d0-4bab-9658-470844837df6 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.199650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745666c6-54d0-4bab-9658-470844837df6 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.204331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4038e6-af08-4bc6-af26-cc8c14e86726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.204979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4038e6-af08-4bc6-af26-cc8c14e86726 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.205262 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4038e6-af08-4bc6-af26-cc8c14e86726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.205536 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4038e6-af08-4bc6-af26-cc8c14e86726 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.206348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4038e6-af08-4bc6-af26-cc8c14e86726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.208816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4038e6-af08-4bc6-af26-cc8c14e86726 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.237191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 955/1911] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:48 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:48.238468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31081e9b-368a-4bb2-aa28-0a29ee7c632e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.249120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31081e9b-368a-4bb2-aa28-0a29ee7c632e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.304175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc5b4-2a51-44b3-9eeb-0ffe8bb833ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.304785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc5b4-2a51-44b3-9eeb-0ffe8bb833ff admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.305067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc5b4-2a51-44b3-9eeb-0ffe8bb833ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.305343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edc5b4-2a51-44b3-9eeb-0ffe8bb833ff admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.306075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edc5b4-2a51-44b3-9eeb-0ffe8bb833ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.308076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50edc5b4-2a51-44b3-9eeb-0ffe8bb833ff admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.328659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 957/1912] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:48 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:48.333335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4038e6-af08-4bc6-af26-cc8c14e86726 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.343587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4038e6-af08-4bc6-af26-cc8c14e86726 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.348446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f628109-5ca0-4414-a413-f9eaf6120118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.349124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628109-5ca0-4414-a413-f9eaf6120118 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.349407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628109-5ca0-4414-a413-f9eaf6120118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.349683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f628109-5ca0-4414-a413-f9eaf6120118 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.350406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f628109-5ca0-4414-a413-f9eaf6120118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.352059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f628109-5ca0-4414-a413-f9eaf6120118 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.362503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 956/1913] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:31:48.366532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc5b4-2a51-44b3-9eeb-0ffe8bb833ff admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.376648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edc5b4-2a51-44b3-9eeb-0ffe8bb833ff admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.382443 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6eadb-901d-4c29-bc23-3c6b17674033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.383147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6eadb-901d-4c29-bc23-3c6b17674033 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.383436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6eadb-901d-4c29-bc23-3c6b17674033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.383715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6eadb-901d-4c29-bc23-3c6b17674033 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.384481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6eadb-901d-4c29-bc23-3c6b17674033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.386078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6eadb-901d-4c29-bc23-3c6b17674033 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.396682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 958/1914] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:48.400823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f628109-5ca0-4414-a413-f9eaf6120118 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.410557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f628109-5ca0-4414-a413-f9eaf6120118 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.415296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b899844-8ef8-4eb1-b0c9-0151278764e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.416178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b899844-8ef8-4eb1-b0c9-0151278764e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.416456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b899844-8ef8-4eb1-b0c9-0151278764e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.416734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b899844-8ef8-4eb1-b0c9-0151278764e4 admin admin] PATH_INFO: `/v3/projects/653cbfde64074bec959367b521063ca7/users/ee92f54ae5da4f47bf38cde053a1cab1/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.430737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b899844-8ef8-4eb1-b0c9-0151278764e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653cbfde64074bec959367b521063ca7, user_id=ee92f54ae5da4f47bf38cde053a1cab1, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.433394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b899844-8ef8-4eb1-b0c9-0151278764e4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.446165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 957/1915] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:48 2022] PUT /identity/v3/projects/653cbfde64074bec959367b521063ca7/users/ee92f54ae5da4f47bf38cde053a1cab1/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:48.457753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89728a97-c73d-4bea-995f-31382fa6e1cf None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.458043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89728a97-c73d-4bea-995f-31382fa6e1cf None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.458320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89728a97-c73d-4bea-995f-31382fa6e1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.483681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-89728a97-c73d-4bea-995f-31382fa6e1cf None None] MFA Rules not processed for user `ee92f54ae5da4f47bf38cde053a1cab1`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:48.484946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-89728a97-c73d-4bea-995f-31382fa6e1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:48.547257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 959/1916] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:48.552181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b899844-8ef8-4eb1-b0c9-0151278764e4 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.614566 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b899844-8ef8-4eb1-b0c9-0151278764e4 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.619205 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c922f-7d1e-4d8a-99a8-2da2bde35b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.619892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c922f-7d1e-4d8a-99a8-2da2bde35b2a admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.620174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c922f-7d1e-4d8a-99a8-2da2bde35b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.620516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c922f-7d1e-4d8a-99a8-2da2bde35b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.621276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c922f-7d1e-4d8a-99a8-2da2bde35b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.623160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c922f-7d1e-4d8a-99a8-2da2bde35b2a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.653220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 958/1917] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:48 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:48.654478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89728a97-c73d-4bea-995f-31382fa6e1cf None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.666956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89728a97-c73d-4bea-995f-31382fa6e1cf None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.736674 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209595ee-b9c3-48a9-8854-ea180d243d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.737384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209595ee-b9c3-48a9-8854-ea180d243d55 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.737745 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209595ee-b9c3-48a9-8854-ea180d243d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.738055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209595ee-b9c3-48a9-8854-ea180d243d55 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.740016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209595ee-b9c3-48a9-8854-ea180d243d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.741694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209595ee-b9c3-48a9-8854-ea180d243d55 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.766976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 960/1918] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:48 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:31:48.771582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c922f-7d1e-4d8a-99a8-2da2bde35b2a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.786558 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c922f-7d1e-4d8a-99a8-2da2bde35b2a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.792504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a276-6a9a-47f0-9f30-423efeb41946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.792504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a276-6a9a-47f0-9f30-423efeb41946 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.792858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a276-6a9a-47f0-9f30-423efeb41946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.793084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a276-6a9a-47f0-9f30-423efeb41946 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.794017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188a276-6a9a-47f0-9f30-423efeb41946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.796187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188a276-6a9a-47f0-9f30-423efeb41946 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.815371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 959/1919] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:48.816955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209595ee-b9c3-48a9-8854-ea180d243d55 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.834038 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209595ee-b9c3-48a9-8854-ea180d243d55 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.842636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f064e-00a5-4c88-a695-0538f87dc655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.845394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f064e-00a5-4c88-a695-0538f87dc655 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.845394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f064e-00a5-4c88-a695-0538f87dc655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.845394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f064e-00a5-4c88-a695-0538f87dc655 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.845394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f064e-00a5-4c88-a695-0538f87dc655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.846826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f064e-00a5-4c88-a695-0538f87dc655 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.858677 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 961/1920] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:48.862763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a276-6a9a-47f0-9f30-423efeb41946 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:48.878384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a276-6a9a-47f0-9f30-423efeb41946 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:48.885638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bf81-5256-4555-8ecf-440ab6142128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:48.886970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bf81-5256-4555-8ecf-440ab6142128 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.887446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bf81-5256-4555-8ecf-440ab6142128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.887876 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726bf81-5256-4555-8ecf-440ab6142128 admin admin] PATH_INFO: `/v3/projects/87b7b57cff2e446c8865b5b3ca17ee8e/users/ee7a4a71bed848fc9e8d6366df794476/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.903524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726bf81-5256-4555-8ecf-440ab6142128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87b7b57cff2e446c8865b5b3ca17ee8e, user_id=ee7a4a71bed848fc9e8d6366df794476, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:48.906448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726bf81-5256-4555-8ecf-440ab6142128 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:48.921303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 960/1921] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:48 2022] PUT /identity/v3/projects/87b7b57cff2e446c8865b5b3ca17ee8e/users/ee7a4a71bed848fc9e8d6366df794476/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:48.932979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550fbc1-33a1-4ff5-a327-fc8ff560cb38 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:48.933270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550fbc1-33a1-4ff5-a327-fc8ff560cb38 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:48.933550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550fbc1-33a1-4ff5-a327-fc8ff560cb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:48.962427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e550fbc1-33a1-4ff5-a327-fc8ff560cb38 None None] MFA Rules not processed for user `ee7a4a71bed848fc9e8d6366df794476`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:48.963691 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e550fbc1-33a1-4ff5-a327-fc8ff560cb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:49.026544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 962/1922] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:49.032542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bf81-5256-4555-8ecf-440ab6142128 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:49.099833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726bf81-5256-4555-8ecf-440ab6142128 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:49.105269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d679b7-04da-459f-94a0-a2cf78ac1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:49.110323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d679b7-04da-459f-94a0-a2cf78ac1758 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:49.110323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d679b7-04da-459f-94a0-a2cf78ac1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:49.110323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d679b7-04da-459f-94a0-a2cf78ac1758 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:49.110323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d679b7-04da-459f-94a0-a2cf78ac1758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:49.110323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d679b7-04da-459f-94a0-a2cf78ac1758 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:49.154261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 961/1923] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:31:49 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:49.158596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550fbc1-33a1-4ff5-a327-fc8ff560cb38 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:49.171193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550fbc1-33a1-4ff5-a327-fc8ff560cb38 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:49.235441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac334d1a-389a-46fd-8b5f-c120d59be2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:49.236132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac334d1a-389a-46fd-8b5f-c120d59be2c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:49.236418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac334d1a-389a-46fd-8b5f-c120d59be2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:49.236697 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac334d1a-389a-46fd-8b5f-c120d59be2c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:49.237577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac334d1a-389a-46fd-8b5f-c120d59be2c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:49.240207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac334d1a-389a-46fd-8b5f-c120d59be2c9 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:49.268575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 963/1924] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:31:49 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:31:49.274238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d679b7-04da-459f-94a0-a2cf78ac1758 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:49.291601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d679b7-04da-459f-94a0-a2cf78ac1758 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:49.297992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95b6e5-8062-4dd9-a9f6-6298cdeabcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:49.298955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95b6e5-8062-4dd9-a9f6-6298cdeabcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:49.299341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95b6e5-8062-4dd9-a9f6-6298cdeabcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:49.299850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95b6e5-8062-4dd9-a9f6-6298cdeabcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:49.301435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95b6e5-8062-4dd9-a9f6-6298cdeabcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:49.304163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95b6e5-8062-4dd9-a9f6-6298cdeabcf5 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:49.322279 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 962/1925] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:49.323483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac334d1a-389a-46fd-8b5f-c120d59be2c9 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:49.334173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac334d1a-389a-46fd-8b5f-c120d59be2c9 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:49.339546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f38dc-cc6c-4db9-922d-5081dadfe61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:49.340805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f38dc-cc6c-4db9-922d-5081dadfe61f admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:49.341193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f38dc-cc6c-4db9-922d-5081dadfe61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:49.341568 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f38dc-cc6c-4db9-922d-5081dadfe61f admin admin] PATH_INFO: `/v3/projects/e1c06d092c0743829e7ae68a484e0db0/users/fe95912dea8f4146af316eeb9da45a27/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:49.360140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f38dc-cc6c-4db9-922d-5081dadfe61f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c06d092c0743829e7ae68a484e0db0, user_id=fe95912dea8f4146af316eeb9da45a27, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:49.362917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f38dc-cc6c-4db9-922d-5081dadfe61f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:49.377245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 964/1926] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:49 2022] PUT /identity/v3/projects/e1c06d092c0743829e7ae68a484e0db0/users/fe95912dea8f4146af316eeb9da45a27/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:31:49.381037 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95b6e5-8062-4dd9-a9f6-6298cdeabcf5 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:49.396392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95b6e5-8062-4dd9-a9f6-6298cdeabcf5 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:49.455495 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746bad9-2d4a-43b2-879e-6e3a28201c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:49.456190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746bad9-2d4a-43b2-879e-6e3a28201c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:49.456478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746bad9-2d4a-43b2-879e-6e3a28201c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:49.457430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746bad9-2d4a-43b2-879e-6e3a28201c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:49.458448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746bad9-2d4a-43b2-879e-6e3a28201c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:49.460116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746bad9-2d4a-43b2-879e-6e3a28201c04 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:49.470907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 963/1927] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:31:49.476344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f38dc-cc6c-4db9-922d-5081dadfe61f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:49.487141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f38dc-cc6c-4db9-922d-5081dadfe61f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:49.491930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b99c37-2ceb-4ad8-a4ee-6ec73620d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:49.492820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b99c37-2ceb-4ad8-a4ee-6ec73620d305 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:49.493108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b99c37-2ceb-4ad8-a4ee-6ec73620d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:49.493386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b99c37-2ceb-4ad8-a4ee-6ec73620d305 admin admin] PATH_INFO: `/v3/projects/e1c06d092c0743829e7ae68a484e0db0/users/fe95912dea8f4146af316eeb9da45a27/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:49.495442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b99c37-2ceb-4ad8-a4ee-6ec73620d305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c06d092c0743829e7ae68a484e0db0, user_id=fe95912dea8f4146af316eeb9da45a27, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:49.498219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b99c37-2ceb-4ad8-a4ee-6ec73620d305 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:49.509118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 965/1928] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:31:49 2022] PUT /identity/v3/projects/e1c06d092c0743829e7ae68a484e0db0/users/fe95912dea8f4146af316eeb9da45a27/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:31:49.520211 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0152c-f1b5-4f17-8cf3-233951e4ee94 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:49.521073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0152c-f1b5-4f17-8cf3-233951e4ee94 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:49.521073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0152c-f1b5-4f17-8cf3-233951e4ee94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:49.548478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5ac0152c-f1b5-4f17-8cf3-233951e4ee94 None None] MFA Rules not processed for user `fe95912dea8f4146af316eeb9da45a27`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:31:49.549805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5ac0152c-f1b5-4f17-8cf3-233951e4ee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:49.619761 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 964/1929] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:31:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:31:49.630601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b99c37-2ceb-4ad8-a4ee-6ec73620d305 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:49.632847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-80b99c37-2ceb-4ad8-a4ee-6ec73620d305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:49.690613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b99c37-2ceb-4ad8-a4ee-6ec73620d305 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:49.694259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f3f17-361c-407e-b2b1-eb93b7740edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:49.694904 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f3f17-361c-407e-b2b1-eb93b7740edf service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:49.695233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f3f17-361c-407e-b2b1-eb93b7740edf service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:49.695515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f3f17-361c-407e-b2b1-eb93b7740edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:49.704715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f3f17-361c-407e-b2b1-eb93b7740edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:49.706168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f3f17-361c-407e-b2b1-eb93b7740edf service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:49.716420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 966/1930] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:31:50.462982 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0152c-f1b5-4f17-8cf3-233951e4ee94 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:31:50.466659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5ac0152c-f1b5-4f17-8cf3-233951e4ee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:31:50.487131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0152c-f1b5-4f17-8cf3-233951e4ee94 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:31:50.491846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2aa2a1-b64d-4d45-8886-8b5fda1f5ebd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:31:50.492508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aa2a1-b64d-4d45-8886-8b5fda1f5ebd service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:31:50.492887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aa2a1-b64d-4d45-8886-8b5fda1f5ebd service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:31:50.493176 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aa2a1-b64d-4d45-8886-8b5fda1f5ebd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:31:50.577232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2aa2a1-b64d-4d45-8886-8b5fda1f5ebd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:31:50.578875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2aa2a1-b64d-4d45-8886-8b5fda1f5ebd service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:31:50.589848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 965/1931] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:31:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:05.149765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f3f17-361c-407e-b2b1-eb93b7740edf service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:05.152107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d00f3f17-361c-407e-b2b1-eb93b7740edf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:05.237724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f3f17-361c-407e-b2b1-eb93b7740edf service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:05.242374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:05.244402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:05.244402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:05.244402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] PATH_INFO: `/v3/users/c4b8a6ebc6fa41818678eacb8b80bffc` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:05.245658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b8a6ebc6fa41818678eacb8b80bffc)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:05.247748 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:05.341573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b8a6ebc6fa41818678eacb8b80bffc'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:05.358835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b8a6ebc6fa41818678eacb8b80bffc'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:05.359930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b8a6ebc6fa41818678eacb8b80bffc'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:05.361068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b8a6ebc6fa41818678eacb8b80bffc'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:05.379283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b8a6ebc6fa41818678eacb8b80bffc'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:05.404466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 967/1932] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:05 2022] DELETE /identity/v3/users/c4b8a6ebc6fa41818678eacb8b80bffc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:05.410564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307b610-ba4f-4153-bbf5-2b7874f86f15 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:05.410999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307b610-ba4f-4153-bbf5-2b7874f86f15 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:05.411187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307b610-ba4f-4153-bbf5-2b7874f86f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:05.444853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2307b610-ba4f-4153-bbf5-2b7874f86f15 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:05.464159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2307b610-ba4f-4153-bbf5-2b7874f86f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:05.623767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 966/1933] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:05.632073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:05.633662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:05.713016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d203da7-74fc-41d3-82ec-048506d1c74e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:05.717332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7e340-780b-4061-85ff-c6dd280a7873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:05.718196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7e340-780b-4061-85ff-c6dd280a7873 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:05.718678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7e340-780b-4061-85ff-c6dd280a7873 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:05.719138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7e340-780b-4061-85ff-c6dd280a7873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:05.729339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7e340-780b-4061-85ff-c6dd280a7873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:05.730824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7e340-780b-4061-85ff-c6dd280a7873 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:05.741785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 968/1934] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:06.218523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307b610-ba4f-4153-bbf5-2b7874f86f15 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:06.220169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2307b610-ba4f-4153-bbf5-2b7874f86f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:06.239589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307b610-ba4f-4153-bbf5-2b7874f86f15 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:06.252138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:06.254124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:06.254988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:06.255475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] PATH_INFO: `/v3/projects/4689a907d5654c58aed805c453a20833` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:06.258690 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4689a907d5654c58aed805c453a20833)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:06.261589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:06.317535 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4689a907d5654c58aed805c453a20833', 'request_id': 'req-66a95fb5-19df-4cc5-abdd-89e60d58f048'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.323865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4689a907d5654c58aed805c453a20833', 'request_id': 'req-66a95fb5-19df-4cc5-abdd-89e60d58f048'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.330108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4689a907d5654c58aed805c453a20833', 'request_id': 'req-66a95fb5-19df-4cc5-abdd-89e60d58f048'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.342932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] The token cache is being invalidate because project 4689a907d5654c58aed805c453a20833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:06.343522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.344170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.345964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 967/1935] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:06 2022] DELETE /identity/v3/projects/4689a907d5654c58aed805c453a20833 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:06.350189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7e340-780b-4061-85ff-c6dd280a7873 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:06.360178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7e340-780b-4061-85ff-c6dd280a7873 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:06.416556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:06.417428 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:06.417709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:06.417984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] PATH_INFO: `/v3/users/992e61ba527f446cac134866c8d20fb9` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:06.419202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] RBAC: Authorizing `identity:delete_user(user_id=992e61ba527f446cac134866c8d20fb9)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:06.421133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:06.465927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '992e61ba527f446cac134866c8d20fb9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.473238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '992e61ba527f446cac134866c8d20fb9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.473877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '992e61ba527f446cac134866c8d20fb9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.474594 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '992e61ba527f446cac134866c8d20fb9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.485765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9f4d5f32-6ad3-4828-b638-bcc561e6856d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '992e61ba527f446cac134866c8d20fb9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.498660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 969/1936] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:06 2022] DELETE /identity/v3/users/992e61ba527f446cac134866c8d20fb9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:06.774113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:06.775964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:06.789440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a95fb5-19df-4cc5-abdd-89e60d58f048 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:06.844219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:06.845125 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:06.845730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:06.846020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] PATH_INFO: `/v3/projects/3b86f32a05bd4c7c9070dfe0cdaf22ee` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:06.847825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b86f32a05bd4c7c9070dfe0cdaf22ee)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:06.849757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:06.894205 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b86f32a05bd4c7c9070dfe0cdaf22ee', 'request_id': 'req-d995375e-9ebb-4174-ae71-f1e62531501a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.900228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b86f32a05bd4c7c9070dfe0cdaf22ee', 'request_id': 'req-d995375e-9ebb-4174-ae71-f1e62531501a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.905551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b86f32a05bd4c7c9070dfe0cdaf22ee', 'request_id': 'req-d995375e-9ebb-4174-ae71-f1e62531501a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.919483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] The token cache is being invalidate because project 3b86f32a05bd4c7c9070dfe0cdaf22ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:06.919777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.920405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d995375e-9ebb-4174-ae71-f1e62531501a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:06.922281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 968/1937] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:06 2022] DELETE /identity/v3/projects/3b86f32a05bd4c7c9070dfe0cdaf22ee => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:06.927662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d265ee-16d9-4b1b-a159-a3a8f86da939 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:06.928062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d265ee-16d9-4b1b-a159-a3a8f86da939 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:06.928357 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d265ee-16d9-4b1b-a159-a3a8f86da939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:06.948542 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-50d265ee-16d9-4b1b-a159-a3a8f86da939 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:06.949823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-50d265ee-16d9-4b1b-a159-a3a8f86da939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:07.009442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 970/1938] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:07.017365 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a146d1-4858-4c2f-825d-4578dbc9ceff None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:07.017593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a146d1-4858-4c2f-825d-4578dbc9ceff None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:07.017875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a146d1-4858-4c2f-825d-4578dbc9ceff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:07.036635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-76a146d1-4858-4c2f-825d-4578dbc9ceff None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:07.037839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-76a146d1-4858-4c2f-825d-4578dbc9ceff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:07.045691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 969/1939] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:07.049960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d265ee-16d9-4b1b-a159-a3a8f86da939 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:07.059415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d265ee-16d9-4b1b-a159-a3a8f86da939 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:07.063939 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d2386-0ce4-41a4-bca3-eebc1cbb2528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:07.064601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d2386-0ce4-41a4-bca3-eebc1cbb2528 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:07.064886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d2386-0ce4-41a4-bca3-eebc1cbb2528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:07.065164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d2386-0ce4-41a4-bca3-eebc1cbb2528 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:07.066431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d2386-0ce4-41a4-bca3-eebc1cbb2528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:07.066736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d2386-0ce4-41a4-bca3-eebc1cbb2528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:07.068370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d2386-0ce4-41a4-bca3-eebc1cbb2528 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:07.079597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 971/1940] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:32:07.084500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a146d1-4858-4c2f-825d-4578dbc9ceff None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:07.094043 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a146d1-4858-4c2f-825d-4578dbc9ceff None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:07.099893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfd0e8-2f4c-4454-978a-a42a76990f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:07.100590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfd0e8-2f4c-4454-978a-a42a76990f6e admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:07.100877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfd0e8-2f4c-4454-978a-a42a76990f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:07.101155 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddfd0e8-2f4c-4454-978a-a42a76990f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:07.102248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfd0e8-2f4c-4454-978a-a42a76990f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:07.103826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddfd0e8-2f4c-4454-978a-a42a76990f6e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:07.132906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 970/1941] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:07 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:32:07.134122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d2386-0ce4-41a4-bca3-eebc1cbb2528 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:07.146038 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d2386-0ce4-41a4-bca3-eebc1cbb2528 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:07.205158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c11123-7483-438c-bc92-8293f108b639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:07.205858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11123-7483-438c-bc92-8293f108b639 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:07.206148 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11123-7483-438c-bc92-8293f108b639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:07.206459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c11123-7483-438c-bc92-8293f108b639 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:07.207197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c11123-7483-438c-bc92-8293f108b639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:07.209144 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c11123-7483-438c-bc92-8293f108b639 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:07.230442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 972/1942] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:07 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:07.234849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfd0e8-2f4c-4454-978a-a42a76990f6e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:07.247310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddfd0e8-2f4c-4454-978a-a42a76990f6e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:07.252545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df39d0-5e39-46c8-b3d4-0a253dd496ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:07.253384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df39d0-5e39-46c8-b3d4-0a253dd496ee admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:07.254449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df39d0-5e39-46c8-b3d4-0a253dd496ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:07.254830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df39d0-5e39-46c8-b3d4-0a253dd496ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:07.255679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df39d0-5e39-46c8-b3d4-0a253dd496ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:07.257859 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df39d0-5e39-46c8-b3d4-0a253dd496ee admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:07.272028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 971/1943] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:32:07.276949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c11123-7483-438c-bc92-8293f108b639 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:07.288112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c11123-7483-438c-bc92-8293f108b639 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:07.295121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d309-d90a-4f33-b3b4-d3d755ce4d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:07.295977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d309-d90a-4f33-b3b4-d3d755ce4d9f admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:07.296396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d309-d90a-4f33-b3b4-d3d755ce4d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:07.296811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d309-d90a-4f33-b3b4-d3d755ce4d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:07.297722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d309-d90a-4f33-b3b4-d3d755ce4d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:07.299730 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d309-d90a-4f33-b3b4-d3d755ce4d9f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:07.324696 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 973/1944] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:07.325907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df39d0-5e39-46c8-b3d4-0a253dd496ee admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:07.336731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df39d0-5e39-46c8-b3d4-0a253dd496ee admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:07.341908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84e28-ce15-4068-bd20-0233df4e3c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:07.342842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84e28-ce15-4068-bd20-0233df4e3c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:07.343462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84e28-ce15-4068-bd20-0233df4e3c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:07.343774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a84e28-ce15-4068-bd20-0233df4e3c34 admin admin] PATH_INFO: `/v3/projects/c4c9ef050ceb4ddcbe406cca55261308/users/d7b49f8add0d4dce8a428a5093a3ad07/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:07.363861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a84e28-ce15-4068-bd20-0233df4e3c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c9ef050ceb4ddcbe406cca55261308, user_id=d7b49f8add0d4dce8a428a5093a3ad07, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:07.366560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a84e28-ce15-4068-bd20-0233df4e3c34 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:07.379612 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 972/1945] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:07 2022] PUT /identity/v3/projects/c4c9ef050ceb4ddcbe406cca55261308/users/d7b49f8add0d4dce8a428a5093a3ad07/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:07.390448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424d4d5-f301-4da6-be36-b14b5e34a5d6 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:07.390917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424d4d5-f301-4da6-be36-b14b5e34a5d6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:07.391069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424d4d5-f301-4da6-be36-b14b5e34a5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:07.418099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-2424d4d5-f301-4da6-be36-b14b5e34a5d6 None None] MFA Rules not processed for user `d7b49f8add0d4dce8a428a5093a3ad07`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:07.419355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2424d4d5-f301-4da6-be36-b14b5e34a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:07.484199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 974/1946] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:07.497038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84e28-ce15-4068-bd20-0233df4e3c34 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:07.498798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d8a84e28-ce15-4068-bd20-0233df4e3c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:07.570238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a84e28-ce15-4068-bd20-0233df4e3c34 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:07.574184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14c449-565a-4097-a78e-9fe1739b7b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:07.574853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14c449-565a-4097-a78e-9fe1739b7b9f service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:07.575171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14c449-565a-4097-a78e-9fe1739b7b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:07.575457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14c449-565a-4097-a78e-9fe1739b7b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:07.592903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14c449-565a-4097-a78e-9fe1739b7b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:07.594445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14c449-565a-4097-a78e-9fe1739b7b9f service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:07.605309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 973/1947] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:11.131899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424d4d5-f301-4da6-be36-b14b5e34a5d6 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:11.133888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2424d4d5-f301-4da6-be36-b14b5e34a5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:11.208184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424d4d5-f301-4da6-be36-b14b5e34a5d6 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:11.214272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:11.215288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:11.215578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:11.215858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] PATH_INFO: `/v3/users/b176021036e7461db389f34f342c6a52` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:11.217419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b176021036e7461db389f34f342c6a52)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:11.219711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:11.296697 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b176021036e7461db389f34f342c6a52'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:11.309660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b176021036e7461db389f34f342c6a52'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:11.310967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b176021036e7461db389f34f342c6a52'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:11.313115 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b176021036e7461db389f34f342c6a52'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:11.337878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b176021036e7461db389f34f342c6a52'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:11.356780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 975/1948] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:11 2022] DELETE /identity/v3/users/b176021036e7461db389f34f342c6a52 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:11.358283 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49419b82-6768-47e0-ac79-0591ac08107f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:11.358768 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49419b82-6768-47e0-ac79-0591ac08107f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:11.358842 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49419b82-6768-47e0-ac79-0591ac08107f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:11.377636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-49419b82-6768-47e0-ac79-0591ac08107f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:11.378980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-49419b82-6768-47e0-ac79-0591ac08107f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:11.471172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 974/1949] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:11.693256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:11.694973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:11.705080 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622af60-1d6a-461b-9d05-2af9bb6abe5e None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:11.705280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622af60-1d6a-461b-9d05-2af9bb6abe5e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:11.705841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622af60-1d6a-461b-9d05-2af9bb6abe5e None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:11.708462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 975/1950] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:32:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:32:11.716498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640129c5-add5-430c-acd1-40f8b32173a1 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:11.717074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640129c5-add5-430c-acd1-40f8b32173a1 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:11.717456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640129c5-add5-430c-acd1-40f8b32173a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:11.741173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-640129c5-add5-430c-acd1-40f8b32173a1 None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:11.742736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-640129c5-add5-430c-acd1-40f8b32173a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:11.791997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050223aa-45d5-41e6-bf7c-259942596739 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:11.796590 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bab2-c52e-4a48-ae1c-0df196e89dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:11.797452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bab2-c52e-4a48-ae1c-0df196e89dce service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:11.797774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bab2-c52e-4a48-ae1c-0df196e89dce service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:11.798127 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125bab2-c52e-4a48-ae1c-0df196e89dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:11.809435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125bab2-c52e-4a48-ae1c-0df196e89dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:11.810995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125bab2-c52e-4a48-ae1c-0df196e89dce service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:11.821071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 976/1951] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:11.826081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 976/1952] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:32:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:11.840741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bab2-c52e-4a48-ae1c-0df196e89dce service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:11.841678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1125bab2-c52e-4a48-ae1c-0df196e89dce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:11.859547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125bab2-c52e-4a48-ae1c-0df196e89dce service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:11.866333 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82143b-1383-4463-ac57-9e1f1c29e6bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:11.867396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82143b-1383-4463-ac57-9e1f1c29e6bd service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:11.867721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82143b-1383-4463-ac57-9e1f1c29e6bd service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:11.868096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82143b-1383-4463-ac57-9e1f1c29e6bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:11.885211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82143b-1383-4463-ac57-9e1f1c29e6bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:11.887104 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82143b-1383-4463-ac57-9e1f1c29e6bd service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:11.901740 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 977/1953] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:12.131383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640129c5-add5-430c-acd1-40f8b32173a1 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:12.133145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-640129c5-add5-430c-acd1-40f8b32173a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:12.150156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640129c5-add5-430c-acd1-40f8b32173a1 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:12.164592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:12.166461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:12.167217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:12.167700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] PATH_INFO: `/v3/projects/a944839cc7cc44f4948a8e524ec4de55` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:12.170534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a944839cc7cc44f4948a8e524ec4de55)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:12.175232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:12.239259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a944839cc7cc44f4948a8e524ec4de55', 'request_id': 'req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:12.246163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a944839cc7cc44f4948a8e524ec4de55', 'request_id': 'req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:12.251891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a944839cc7cc44f4948a8e524ec4de55', 'request_id': 'req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:12.268291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] The token cache is being invalidate because project a944839cc7cc44f4948a8e524ec4de55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:12.274207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:12.274207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:12.274207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 977/1954] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:12 2022] DELETE /identity/v3/projects/a944839cc7cc44f4948a8e524ec4de55 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:12.276253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82143b-1383-4463-ac57-9e1f1c29e6bd service nova] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:12.289710 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82143b-1383-4463-ac57-9e1f1c29e6bd service nova] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:12.347171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:12.348090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:12.348412 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:12.349277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] PATH_INFO: `/v3/users/0ef57a899a53402591749ba89fe88114` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:12.350596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef57a899a53402591749ba89fe88114)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:12.352639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:12.416385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef57a899a53402591749ba89fe88114'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:12.426664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef57a899a53402591749ba89fe88114'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:12.428054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef57a899a53402591749ba89fe88114'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:12.428685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef57a899a53402591749ba89fe88114'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:12.443006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef57a899a53402591749ba89fe88114'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:12.459112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 978/1955] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:12 2022] DELETE /identity/v3/users/0ef57a899a53402591749ba89fe88114 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:12.868085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:12.870259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:12.876257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:12.878723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:12.885195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ca9f9-3eed-4af1-8d6b-df275471c18f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:12.956447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5029f82-0168-4d05-a587-966f1b477b3c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:12.966366 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1d2fe-fc80-47a7-b5af-734635a22258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:12.967075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1d2fe-fc80-47a7-b5af-734635a22258 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:12.967370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1d2fe-fc80-47a7-b5af-734635a22258 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:12.967646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1d2fe-fc80-47a7-b5af-734635a22258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:12.971827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e1e1d2fe-fc80-47a7-b5af-734635a22258 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:12.990391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:12.991288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:12.991579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:12.991864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] PATH_INFO: `/v3/projects/77d0224dce8b49e49626a5e2ef3252aa` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:12.993200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d0224dce8b49e49626a5e2ef3252aa)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:12.995362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:13.042480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1d2fe-fc80-47a7-b5af-734635a22258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:13.043983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1d2fe-fc80-47a7-b5af-734635a22258 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:13.047210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d0224dce8b49e49626a5e2ef3252aa', 'request_id': 'req-3060aff8-c607-4437-91a6-b63f86653802'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:13.054164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 979/1956] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:32:13.054351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d0224dce8b49e49626a5e2ef3252aa', 'request_id': 'req-3060aff8-c607-4437-91a6-b63f86653802'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:13.063324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d0224dce8b49e49626a5e2ef3252aa', 'request_id': 'req-3060aff8-c607-4437-91a6-b63f86653802'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:13.080685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] The token cache is being invalidate because project 77d0224dce8b49e49626a5e2ef3252aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:13.081229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:13.081935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3060aff8-c607-4437-91a6-b63f86653802 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:13.088806 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9b862-7551-416a-a715-0daaeb4ebd09 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:13.089107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9b862-7551-416a-a715-0daaeb4ebd09 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:13.089403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9b862-7551-416a-a715-0daaeb4ebd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:13.090959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 978/1957] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:12 2022] DELETE /identity/v3/projects/77d0224dce8b49e49626a5e2ef3252aa => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:13.113431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-51d9b862-7551-416a-a715-0daaeb4ebd09 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:13.114728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-51d9b862-7551-416a-a715-0daaeb4ebd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:13.203360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 980/1958] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:13.205568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1830-6d99-4359-a8e1-b40ec248b0b7 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:13.206964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1830-6d99-4359-a8e1-b40ec248b0b7 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:13.207528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f1830-6d99-4359-a8e1-b40ec248b0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:13.229063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-673f1830-6d99-4359-a8e1-b40ec248b0b7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:13.230398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-673f1830-6d99-4359-a8e1-b40ec248b0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:13.243702 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 979/1959] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:13.252922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9b862-7551-416a-a715-0daaeb4ebd09 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:13.263656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9b862-7551-416a-a715-0daaeb4ebd09 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:13.269346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca5f4a-31bd-4389-b277-c2d74a0916bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:13.270125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca5f4a-31bd-4389-b277-c2d74a0916bd admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:13.270422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca5f4a-31bd-4389-b277-c2d74a0916bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:13.270752 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca5f4a-31bd-4389-b277-c2d74a0916bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:13.271435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca5f4a-31bd-4389-b277-c2d74a0916bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:13.271745 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca5f4a-31bd-4389-b277-c2d74a0916bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:13.273395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca5f4a-31bd-4389-b277-c2d74a0916bd admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:13.287635 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 981/1960] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:32:13.291924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f1830-6d99-4359-a8e1-b40ec248b0b7 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:13.302910 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f1830-6d99-4359-a8e1-b40ec248b0b7 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:13.308384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e57c30-9e00-4284-b76c-1f4804fb67fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:13.309150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e57c30-9e00-4284-b76c-1f4804fb67fd admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:13.309519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e57c30-9e00-4284-b76c-1f4804fb67fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:13.310700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e57c30-9e00-4284-b76c-1f4804fb67fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:13.310700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e57c30-9e00-4284-b76c-1f4804fb67fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:13.312814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e57c30-9e00-4284-b76c-1f4804fb67fd admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:13.375757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 980/1961] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:13 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:13.375907 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca5f4a-31bd-4389-b277-c2d74a0916bd admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:13.385191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca5f4a-31bd-4389-b277-c2d74a0916bd admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:13.455219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74fc78-c5f0-4200-af88-ae46a601ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:13.455803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74fc78-c5f0-4200-af88-ae46a601ff86 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:13.456622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74fc78-c5f0-4200-af88-ae46a601ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:13.457071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74fc78-c5f0-4200-af88-ae46a601ff86 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:13.457916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74fc78-c5f0-4200-af88-ae46a601ff86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:13.460149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74fc78-c5f0-4200-af88-ae46a601ff86 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:13.482869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 982/1962] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:13 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:13.487695 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e57c30-9e00-4284-b76c-1f4804fb67fd admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:13.502368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e57c30-9e00-4284-b76c-1f4804fb67fd admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:13.511498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2411eeb-337e-47a3-9c8d-c1795b82d796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:13.513498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2411eeb-337e-47a3-9c8d-c1795b82d796 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:13.514017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2411eeb-337e-47a3-9c8d-c1795b82d796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:13.514524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2411eeb-337e-47a3-9c8d-c1795b82d796 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:13.516238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2411eeb-337e-47a3-9c8d-c1795b82d796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:13.518371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2411eeb-337e-47a3-9c8d-c1795b82d796 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:13.535891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 981/1963] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:13.537283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74fc78-c5f0-4200-af88-ae46a601ff86 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:13.552691 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74fc78-c5f0-4200-af88-ae46a601ff86 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:13.560690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd222509-8ebc-4d1b-b42a-c990a68af44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:13.561652 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222509-8ebc-4d1b-b42a-c990a68af44d admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:13.562089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222509-8ebc-4d1b-b42a-c990a68af44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:13.562763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd222509-8ebc-4d1b-b42a-c990a68af44d admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:13.564522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd222509-8ebc-4d1b-b42a-c990a68af44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:13.568227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd222509-8ebc-4d1b-b42a-c990a68af44d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:13.580539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 983/1964] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:32:13.585499 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2411eeb-337e-47a3-9c8d-c1795b82d796 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:13.600134 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2411eeb-337e-47a3-9c8d-c1795b82d796 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:13.611304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a4558-e2d5-42b6-a854-5f65946b60d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:13.613247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a4558-e2d5-42b6-a854-5f65946b60d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:13.613522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a4558-e2d5-42b6-a854-5f65946b60d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:13.614009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a4558-e2d5-42b6-a854-5f65946b60d8 admin admin] PATH_INFO: `/v3/projects/317fa8ddc4ea4b3c8d142a81f79f9c79/users/fa3316dfe5d84f7d8d4799f9a56316c4/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:13.639386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a4558-e2d5-42b6-a854-5f65946b60d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=317fa8ddc4ea4b3c8d142a81f79f9c79, user_id=fa3316dfe5d84f7d8d4799f9a56316c4, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:13.642445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a4558-e2d5-42b6-a854-5f65946b60d8 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:13.677451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 982/1965] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:13 2022] PUT /identity/v3/projects/317fa8ddc4ea4b3c8d142a81f79f9c79/users/fa3316dfe5d84f7d8d4799f9a56316c4/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:13.700810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f634c5-aad5-4faa-a609-fdab1315d578 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:13.701687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f634c5-aad5-4faa-a609-fdab1315d578 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:13.702187 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f634c5-aad5-4faa-a609-fdab1315d578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:13.759300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-30f634c5-aad5-4faa-a609-fdab1315d578 None None] MFA Rules not processed for user `fa3316dfe5d84f7d8d4799f9a56316c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:13.760707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-30f634c5-aad5-4faa-a609-fdab1315d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:13.865393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 984/1966] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:13.869951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a4558-e2d5-42b6-a854-5f65946b60d8 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:14.005614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a4558-e2d5-42b6-a854-5f65946b60d8 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:14.011319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e364d8b-5aac-4011-aa8c-a55faf429830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:14.012108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e364d8b-5aac-4011-aa8c-a55faf429830 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:14.012944 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e364d8b-5aac-4011-aa8c-a55faf429830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:14.013476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e364d8b-5aac-4011-aa8c-a55faf429830 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:14.014319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e364d8b-5aac-4011-aa8c-a55faf429830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:14.018366 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e364d8b-5aac-4011-aa8c-a55faf429830 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:14.059490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 983/1967] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:13 2022] POST /identity/v3/projects => generated 367 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:32:14.060866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f634c5-aad5-4faa-a609-fdab1315d578 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:14.077684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f634c5-aad5-4faa-a609-fdab1315d578 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:14.168222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a29a7-2eb6-432a-96a5-763f9b9f523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:14.169172 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a29a7-2eb6-432a-96a5-763f9b9f523e admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:14.169414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a29a7-2eb6-432a-96a5-763f9b9f523e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:14.169768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a29a7-2eb6-432a-96a5-763f9b9f523e admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:14.170585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a29a7-2eb6-432a-96a5-763f9b9f523e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:14.173521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a29a7-2eb6-432a-96a5-763f9b9f523e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:14.210203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 985/1968] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:14 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:14.214269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e364d8b-5aac-4011-aa8c-a55faf429830 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:14.228997 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e364d8b-5aac-4011-aa8c-a55faf429830 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:14.244484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0367d8-1e71-45f6-829f-414f9b5c6df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:14.245183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0367d8-1e71-45f6-829f-414f9b5c6df9 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:14.245502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0367d8-1e71-45f6-829f-414f9b5c6df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:14.245860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0367d8-1e71-45f6-829f-414f9b5c6df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:14.246819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0367d8-1e71-45f6-829f-414f9b5c6df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:14.248885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0367d8-1e71-45f6-829f-414f9b5c6df9 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:14.261403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 984/1969] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:14.266537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a29a7-2eb6-432a-96a5-763f9b9f523e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:14.278285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a29a7-2eb6-432a-96a5-763f9b9f523e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:14.285072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea4e26-a67e-4f04-888c-123eb6b59f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:14.286240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea4e26-a67e-4f04-888c-123eb6b59f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:14.286525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea4e26-a67e-4f04-888c-123eb6b59f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:14.286796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea4e26-a67e-4f04-888c-123eb6b59f79 admin admin] PATH_INFO: `/v3/projects/b0511bb297ab47a29e178b032bc9d091/users/e91641d2d2bb4f89970f36cb0165e894/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:14.303436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea4e26-a67e-4f04-888c-123eb6b59f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0511bb297ab47a29e178b032bc9d091, user_id=e91641d2d2bb4f89970f36cb0165e894, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:14.306802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea4e26-a67e-4f04-888c-123eb6b59f79 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:14.337250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 986/1970] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:14 2022] PUT /identity/v3/projects/b0511bb297ab47a29e178b032bc9d091/users/e91641d2d2bb4f89970f36cb0165e894/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:14.341216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0367d8-1e71-45f6-829f-414f9b5c6df9 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:14.355193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0367d8-1e71-45f6-829f-414f9b5c6df9 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:14.420720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff5741-aa3d-42d9-8559-df46aaf4aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:14.421406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5741-aa3d-42d9-8559-df46aaf4aa85 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:14.421689 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5741-aa3d-42d9-8559-df46aaf4aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:14.421970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff5741-aa3d-42d9-8559-df46aaf4aa85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:14.422709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff5741-aa3d-42d9-8559-df46aaf4aa85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:14.424355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff5741-aa3d-42d9-8559-df46aaf4aa85 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:14.435612 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 985/1971] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:14.439783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea4e26-a67e-4f04-888c-123eb6b59f79 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:14.457707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea4e26-a67e-4f04-888c-123eb6b59f79 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:14.457707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f72cd-a33c-4e6a-9f0d-fd759156f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:14.457707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f72cd-a33c-4e6a-9f0d-fd759156f48a admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:14.457707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f72cd-a33c-4e6a-9f0d-fd759156f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:14.458188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f72cd-a33c-4e6a-9f0d-fd759156f48a admin admin] PATH_INFO: `/v3/projects/b0511bb297ab47a29e178b032bc9d091/users/e91641d2d2bb4f89970f36cb0165e894/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:14.459372 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f72cd-a33c-4e6a-9f0d-fd759156f48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0511bb297ab47a29e178b032bc9d091, user_id=e91641d2d2bb4f89970f36cb0165e894, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:14.462071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f72cd-a33c-4e6a-9f0d-fd759156f48a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:14.473529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 987/1972] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:14 2022] PUT /identity/v3/projects/b0511bb297ab47a29e178b032bc9d091/users/e91641d2d2bb4f89970f36cb0165e894/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:14.484203 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1515be-5cb5-4915-b04a-ad05f092cb1c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:14.484656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1515be-5cb5-4915-b04a-ad05f092cb1c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:14.484951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1515be-5cb5-4915-b04a-ad05f092cb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:14.514576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-cf1515be-5cb5-4915-b04a-ad05f092cb1c None None] MFA Rules not processed for user `e91641d2d2bb4f89970f36cb0165e894`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:14.515846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cf1515be-5cb5-4915-b04a-ad05f092cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:14.584346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 986/1973] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:14.595995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f72cd-a33c-4e6a-9f0d-fd759156f48a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:14.598267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-875f72cd-a33c-4e6a-9f0d-fd759156f48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:14.656408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f72cd-a33c-4e6a-9f0d-fd759156f48a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:14.660666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa62b0-1985-42ed-b62f-c04127e42afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:14.661314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa62b0-1985-42ed-b62f-c04127e42afa service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:14.661591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa62b0-1985-42ed-b62f-c04127e42afa service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:14.661864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa62b0-1985-42ed-b62f-c04127e42afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:14.671071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa62b0-1985-42ed-b62f-c04127e42afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:14.672529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa62b0-1985-42ed-b62f-c04127e42afa service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:14.682917 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 988/1974] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:14.736163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1515be-5cb5-4915-b04a-ad05f092cb1c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:14.746482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1515be-5cb5-4915-b04a-ad05f092cb1c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:14.750182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3aec13-937c-4820-b700-9230e4bf1ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:14.750864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aec13-937c-4820-b700-9230e4bf1ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:14.751158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aec13-937c-4820-b700-9230e4bf1ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:14.751441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3aec13-937c-4820-b700-9230e4bf1ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:14.811503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3aec13-937c-4820-b700-9230e4bf1ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:14.812966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3aec13-937c-4820-b700-9230e4bf1ec6 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:14.822393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 987/1975] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:18.323758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa62b0-1985-42ed-b62f-c04127e42afa service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:18.524339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa62b0-1985-42ed-b62f-c04127e42afa service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:18.529024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:18.529903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:18.530184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:18.530455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] PATH_INFO: `/v3/users/fa3316dfe5d84f7d8d4799f9a56316c4` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:18.531694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3316dfe5d84f7d8d4799f9a56316c4)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:18.533790 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:18.584419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3316dfe5d84f7d8d4799f9a56316c4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:18.591728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3316dfe5d84f7d8d4799f9a56316c4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:18.592719 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3316dfe5d84f7d8d4799f9a56316c4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:18.593367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3316dfe5d84f7d8d4799f9a56316c4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:18.606663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3316dfe5d84f7d8d4799f9a56316c4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:18.625561 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 989/1976] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:18 2022] DELETE /identity/v3/users/fa3316dfe5d84f7d8d4799f9a56316c4 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:18.630335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03180af6-b8fa-417e-8288-054f79a6293c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:18.631206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03180af6-b8fa-417e-8288-054f79a6293c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:18.631206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03180af6-b8fa-417e-8288-054f79a6293c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:18.648399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-03180af6-b8fa-417e-8288-054f79a6293c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:18.649779 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-03180af6-b8fa-417e-8288-054f79a6293c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:18.722450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 988/1977] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:18.732546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:18.733825 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:18.814862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c00cd-8ac4-4289-b7ed-a6f2472d6be7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:18.821509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf613-0c30-4116-9295-31905f5b4313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:18.822018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf613-0c30-4116-9295-31905f5b4313 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:18.822309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf613-0c30-4116-9295-31905f5b4313 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:18.822590 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf613-0c30-4116-9295-31905f5b4313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:18.839504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bf613-0c30-4116-9295-31905f5b4313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:18.840991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bf613-0c30-4116-9295-31905f5b4313 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:18.854018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 990/1978] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:19.194809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03180af6-b8fa-417e-8288-054f79a6293c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:19.196713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-03180af6-b8fa-417e-8288-054f79a6293c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:19.222783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03180af6-b8fa-417e-8288-054f79a6293c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:19.228266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:19.229500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:19.230042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:19.230490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] PATH_INFO: `/v3/projects/317fa8ddc4ea4b3c8d142a81f79f9c79` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:19.231986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=317fa8ddc4ea4b3c8d142a81f79f9c79)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:19.234394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:19.293730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '317fa8ddc4ea4b3c8d142a81f79f9c79', 'request_id': 'req-b88080c6-f83e-4cdc-8744-a2fad041c0e0'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.300239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '317fa8ddc4ea4b3c8d142a81f79f9c79', 'request_id': 'req-b88080c6-f83e-4cdc-8744-a2fad041c0e0'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.306245 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '317fa8ddc4ea4b3c8d142a81f79f9c79', 'request_id': 'req-b88080c6-f83e-4cdc-8744-a2fad041c0e0'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.321705 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] The token cache is being invalidate because project 317fa8ddc4ea4b3c8d142a81f79f9c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:19.322023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.322704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.324313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 989/1979] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:19 2022] DELETE /identity/v3/projects/317fa8ddc4ea4b3c8d142a81f79f9c79 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:19.328311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf613-0c30-4116-9295-31905f5b4313 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:19.338717 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf613-0c30-4116-9295-31905f5b4313 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:19.395082 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:19.395950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:19.396748 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:19.397042 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] PATH_INFO: `/v3/users/e91641d2d2bb4f89970f36cb0165e894` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:19.398262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91641d2d2bb4f89970f36cb0165e894)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:19.400251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:19.446758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91641d2d2bb4f89970f36cb0165e894'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.453427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91641d2d2bb4f89970f36cb0165e894'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.454140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91641d2d2bb4f89970f36cb0165e894'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.454755 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91641d2d2bb4f89970f36cb0165e894'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.467497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a63cf152-2cef-4515-8282-cae531ad3673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91641d2d2bb4f89970f36cb0165e894'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.481393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 991/1980] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:19 2022] DELETE /identity/v3/users/e91641d2d2bb4f89970f36cb0165e894 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:19.781819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:19.784307 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:19.799910 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88080c6-f83e-4cdc-8744-a2fad041c0e0 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:19.877656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:19.878547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:19.878837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:19.879158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] PATH_INFO: `/v3/projects/b0511bb297ab47a29e178b032bc9d091` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:19.880386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0511bb297ab47a29e178b032bc9d091)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:19.882586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:19.934518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0511bb297ab47a29e178b032bc9d091', 'request_id': 'req-048e73ad-175f-4df0-babf-68676042e2ca'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.942679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0511bb297ab47a29e178b032bc9d091', 'request_id': 'req-048e73ad-175f-4df0-babf-68676042e2ca'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.948681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0511bb297ab47a29e178b032bc9d091', 'request_id': 'req-048e73ad-175f-4df0-babf-68676042e2ca'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.963381 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] The token cache is being invalidate because project b0511bb297ab47a29e178b032bc9d091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:19.964595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.965519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-048e73ad-175f-4df0-babf-68676042e2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:19.968035 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 990/1981] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:19 2022] DELETE /identity/v3/projects/b0511bb297ab47a29e178b032bc9d091 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:19.973598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f796e6-fb92-496d-9679-1b61c595ebbb None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:19.973914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f796e6-fb92-496d-9679-1b61c595ebbb None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:19.974197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f796e6-fb92-496d-9679-1b61c595ebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:19.993568 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-61f796e6-fb92-496d-9679-1b61c595ebbb None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:19.994721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-61f796e6-fb92-496d-9679-1b61c595ebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:20.075301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 992/1982] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:20.082880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41d3d1-6830-4b6b-b20e-fc8296b4cfab None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.083218 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41d3d1-6830-4b6b-b20e-fc8296b4cfab None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.083484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41d3d1-6830-4b6b-b20e-fc8296b4cfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.104757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2e41d3d1-6830-4b6b-b20e-fc8296b4cfab None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:20.106044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2e41d3d1-6830-4b6b-b20e-fc8296b4cfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:20.120339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 991/1983] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:20.124760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f796e6-fb92-496d-9679-1b61c595ebbb None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.134761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f796e6-fb92-496d-9679-1b61c595ebbb None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.140121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc83c0-5a38-465a-a59b-cef5f0e36f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.140805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc83c0-5a38-465a-a59b-cef5f0e36f32 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.141089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc83c0-5a38-465a-a59b-cef5f0e36f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.141365 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc83c0-5a38-465a-a59b-cef5f0e36f32 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.142105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc83c0-5a38-465a-a59b-cef5f0e36f32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:20.142410 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc83c0-5a38-465a-a59b-cef5f0e36f32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.144096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc83c0-5a38-465a-a59b-cef5f0e36f32 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:20.162076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 993/1984] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:32:20.166662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41d3d1-6830-4b6b-b20e-fc8296b4cfab None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.178762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41d3d1-6830-4b6b-b20e-fc8296b4cfab None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.183796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bae3a2-a3ad-4c59-9685-ff7ea837e436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.184611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bae3a2-a3ad-4c59-9685-ff7ea837e436 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.184897 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bae3a2-a3ad-4c59-9685-ff7ea837e436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.185178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bae3a2-a3ad-4c59-9685-ff7ea837e436 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.185898 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bae3a2-a3ad-4c59-9685-ff7ea837e436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.187900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bae3a2-a3ad-4c59-9685-ff7ea837e436 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:20.219014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 992/1985] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:20 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:20.226737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc83c0-5a38-465a-a59b-cef5f0e36f32 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.248687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc83c0-5a38-465a-a59b-cef5f0e36f32 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.332700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5ea41-633d-4bbe-8ed7-dd2008c8d671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.333551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5ea41-633d-4bbe-8ed7-dd2008c8d671 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.333684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5ea41-633d-4bbe-8ed7-dd2008c8d671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.333915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5ea41-633d-4bbe-8ed7-dd2008c8d671 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.334621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5ea41-633d-4bbe-8ed7-dd2008c8d671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.336824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5ea41-633d-4bbe-8ed7-dd2008c8d671 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:20.360539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 994/1986] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:20 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:20.365221 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bae3a2-a3ad-4c59-9685-ff7ea837e436 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.376980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bae3a2-a3ad-4c59-9685-ff7ea837e436 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.382624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baad9bb-3332-45b2-bd9e-6ef5ff240b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.383474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baad9bb-3332-45b2-bd9e-6ef5ff240b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.383759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baad9bb-3332-45b2-bd9e-6ef5ff240b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.384061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baad9bb-3332-45b2-bd9e-6ef5ff240b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.384809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baad9bb-3332-45b2-bd9e-6ef5ff240b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.386444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baad9bb-3332-45b2-bd9e-6ef5ff240b1f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:20.400922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 993/1987] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:20.402133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5ea41-633d-4bbe-8ed7-dd2008c8d671 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.415454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5ea41-633d-4bbe-8ed7-dd2008c8d671 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.420715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a41fd-91f5-4b2d-8130-3cc8990d5786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.421486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a41fd-91f5-4b2d-8130-3cc8990d5786 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.421889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a41fd-91f5-4b2d-8130-3cc8990d5786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.422278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a41fd-91f5-4b2d-8130-3cc8990d5786 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.423267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a41fd-91f5-4b2d-8130-3cc8990d5786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.425018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a41fd-91f5-4b2d-8130-3cc8990d5786 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:20.436152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 995/1988] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:20.440455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baad9bb-3332-45b2-bd9e-6ef5ff240b1f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.450582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baad9bb-3332-45b2-bd9e-6ef5ff240b1f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.455496 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f259a-c6ea-4c7d-8a13-c1f3601f0e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.456949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f259a-c6ea-4c7d-8a13-c1f3601f0e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.457229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f259a-c6ea-4c7d-8a13-c1f3601f0e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.457508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f259a-c6ea-4c7d-8a13-c1f3601f0e25 admin admin] PATH_INFO: `/v3/projects/6d3547517eca4af4adb5c68a6ad616e3/users/ef74371a14a540a9bed90603ee25e300/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.472968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f259a-c6ea-4c7d-8a13-c1f3601f0e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3547517eca4af4adb5c68a6ad616e3, user_id=ef74371a14a540a9bed90603ee25e300, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.475909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f259a-c6ea-4c7d-8a13-c1f3601f0e25 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:20.489725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 994/1989] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:20 2022] PUT /identity/v3/projects/6d3547517eca4af4adb5c68a6ad616e3/users/ef74371a14a540a9bed90603ee25e300/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:20.500336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d9a7-389c-4f00-a87f-c7ccc47f5eec None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.500544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d9a7-389c-4f00-a87f-c7ccc47f5eec None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.500820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0d9a7-389c-4f00-a87f-c7ccc47f5eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.539775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-57d0d9a7-389c-4f00-a87f-c7ccc47f5eec None None] MFA Rules not processed for user `ef74371a14a540a9bed90603ee25e300`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:20.541016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-57d0d9a7-389c-4f00-a87f-c7ccc47f5eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:20.611829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 996/1990] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:20.617548 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f259a-c6ea-4c7d-8a13-c1f3601f0e25 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.681145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f259a-c6ea-4c7d-8a13-c1f3601f0e25 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.686119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212baca-ba1b-486d-b4ee-4618dac727ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.686786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212baca-ba1b-486d-b4ee-4618dac727ba admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.687097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212baca-ba1b-486d-b4ee-4618dac727ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.689970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212baca-ba1b-486d-b4ee-4618dac727ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.689970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212baca-ba1b-486d-b4ee-4618dac727ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.690209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212baca-ba1b-486d-b4ee-4618dac727ba admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:20.719447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 995/1991] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:20 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:20.722180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d9a7-389c-4f00-a87f-c7ccc47f5eec None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.734666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0d9a7-389c-4f00-a87f-c7ccc47f5eec None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.794361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3940c-7a85-48c4-b79d-058a3c726a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.795161 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3940c-7a85-48c4-b79d-058a3c726a29 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.795500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3940c-7a85-48c4-b79d-058a3c726a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.795910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3940c-7a85-48c4-b79d-058a3c726a29 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.796749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3940c-7a85-48c4-b79d-058a3c726a29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.798797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3940c-7a85-48c4-b79d-058a3c726a29 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:20.822534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 997/1992] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:20 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:20.826072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212baca-ba1b-486d-b4ee-4618dac727ba admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.836345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212baca-ba1b-486d-b4ee-4618dac727ba admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.840971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bfa9d-222c-4822-84d3-a4d3a035567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.841638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bfa9d-222c-4822-84d3-a4d3a035567a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.841921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bfa9d-222c-4822-84d3-a4d3a035567a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.842199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bfa9d-222c-4822-84d3-a4d3a035567a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.843006 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bfa9d-222c-4822-84d3-a4d3a035567a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.844650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bfa9d-222c-4822-84d3-a4d3a035567a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:20.857417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 996/1993] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:20.862821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3940c-7a85-48c4-b79d-058a3c726a29 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.873976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3940c-7a85-48c4-b79d-058a3c726a29 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.878810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b8281-1a83-402f-8c99-e92dd0d8a14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.879785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b8281-1a83-402f-8c99-e92dd0d8a14e admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.880206 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b8281-1a83-402f-8c99-e92dd0d8a14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.880487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b8281-1a83-402f-8c99-e92dd0d8a14e admin admin] PATH_INFO: `/v3/projects/2754393bb0b64b6eab43c590c7979499/users/4d36c8304de5458092036bd9688fac92/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.897062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b8281-1a83-402f-8c99-e92dd0d8a14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2754393bb0b64b6eab43c590c7979499, user_id=4d36c8304de5458092036bd9688fac92, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.900031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b8281-1a83-402f-8c99-e92dd0d8a14e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:20.917005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 998/1994] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:20 2022] PUT /identity/v3/projects/2754393bb0b64b6eab43c590c7979499/users/4d36c8304de5458092036bd9688fac92/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:20.921508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bfa9d-222c-4822-84d3-a4d3a035567a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:20.933810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bfa9d-222c-4822-84d3-a4d3a035567a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:20.990373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538210a-5eb4-4e47-a7e1-2d2259ca613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:20.991125 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538210a-5eb4-4e47-a7e1-2d2259ca613d admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:20.991494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538210a-5eb4-4e47-a7e1-2d2259ca613d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:20.991766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538210a-5eb4-4e47-a7e1-2d2259ca613d admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:20.992584 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538210a-5eb4-4e47-a7e1-2d2259ca613d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:20.994250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538210a-5eb4-4e47-a7e1-2d2259ca613d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:21.004616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 997/1995] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:21.009616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b8281-1a83-402f-8c99-e92dd0d8a14e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:21.020715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b8281-1a83-402f-8c99-e92dd0d8a14e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:21.025291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c99f48-85f5-46f8-800a-a78b31d20a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:21.026165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c99f48-85f5-46f8-800a-a78b31d20a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:21.026449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c99f48-85f5-46f8-800a-a78b31d20a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:21.026724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c99f48-85f5-46f8-800a-a78b31d20a0a admin admin] PATH_INFO: `/v3/projects/2754393bb0b64b6eab43c590c7979499/users/4d36c8304de5458092036bd9688fac92/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:21.028728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c99f48-85f5-46f8-800a-a78b31d20a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2754393bb0b64b6eab43c590c7979499, user_id=4d36c8304de5458092036bd9688fac92, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:21.031458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c99f48-85f5-46f8-800a-a78b31d20a0a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:21.042012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 999/1996] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:21 2022] PUT /identity/v3/projects/2754393bb0b64b6eab43c590c7979499/users/4d36c8304de5458092036bd9688fac92/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:21.053485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f6961-0f35-4d9f-8a9f-523deed463e8 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:21.053778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f6961-0f35-4d9f-8a9f-523deed463e8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:21.054063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f6961-0f35-4d9f-8a9f-523deed463e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:21.081252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b38f6961-0f35-4d9f-8a9f-523deed463e8 None None] MFA Rules not processed for user `4d36c8304de5458092036bd9688fac92`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:21.082486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b38f6961-0f35-4d9f-8a9f-523deed463e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:21.155586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 998/1997] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:21.168961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c99f48-85f5-46f8-800a-a78b31d20a0a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:21.168961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-77c99f48-85f5-46f8-800a-a78b31d20a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:21.226848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c99f48-85f5-46f8-800a-a78b31d20a0a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:21.230532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c3787-eaee-4e58-bbe9-98ee998250c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:21.231222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c3787-eaee-4e58-bbe9-98ee998250c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:21.231503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c3787-eaee-4e58-bbe9-98ee998250c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:21.231773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c3787-eaee-4e58-bbe9-98ee998250c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:21.241567 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c3787-eaee-4e58-bbe9-98ee998250c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:21.243011 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c3787-eaee-4e58-bbe9-98ee998250c7 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:21.252842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1000/1998] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:21.876964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f6961-0f35-4d9f-8a9f-523deed463e8 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:21.947169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f6961-0f35-4d9f-8a9f-523deed463e8 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:21.952216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:21.953320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:21.953613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:21.954027 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] PATH_INFO: `/v3/users/ef74371a14a540a9bed90603ee25e300` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:21.960265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef74371a14a540a9bed90603ee25e300)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:21.960265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:22.021868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef74371a14a540a9bed90603ee25e300'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.022610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef74371a14a540a9bed90603ee25e300'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.029363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef74371a14a540a9bed90603ee25e300'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.030069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef74371a14a540a9bed90603ee25e300'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.039006 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef74371a14a540a9bed90603ee25e300'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.057451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 999/1999] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:21 2022] DELETE /identity/v3/users/ef74371a14a540a9bed90603ee25e300 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:22.062038 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e76cd0-1a52-4675-9720-c9d264a000fe None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:22.062575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e76cd0-1a52-4675-9720-c9d264a000fe None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:22.062575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e76cd0-1a52-4675-9720-c9d264a000fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:22.080651 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-48e76cd0-1a52-4675-9720-c9d264a000fe None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:22.082393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-48e76cd0-1a52-4675-9720-c9d264a000fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:22.141794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1001/2000] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:22.154338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:22.155799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:22.218004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80684e-5876-4670-9480-8382db52298e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:22.222417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f40dd-ae99-4211-a243-54fde44db300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:22.223114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f40dd-ae99-4211-a243-54fde44db300 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:22.223384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f40dd-ae99-4211-a243-54fde44db300 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:22.223658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f40dd-ae99-4211-a243-54fde44db300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:22.233304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f40dd-ae99-4211-a243-54fde44db300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:22.234735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f40dd-ae99-4211-a243-54fde44db300 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:22.244946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1000/2001] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:22.536893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e76cd0-1a52-4675-9720-c9d264a000fe None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:22.539410 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-48e76cd0-1a52-4675-9720-c9d264a000fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:22.579752 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e76cd0-1a52-4675-9720-c9d264a000fe None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:22.586818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:22.589098 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:22.589680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:22.590233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] PATH_INFO: `/v3/projects/6d3547517eca4af4adb5c68a6ad616e3` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:22.592511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3547517eca4af4adb5c68a6ad616e3)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:22.595055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:22.655672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3547517eca4af4adb5c68a6ad616e3', 'request_id': 'req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.666157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3547517eca4af4adb5c68a6ad616e3', 'request_id': 'req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.673269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3547517eca4af4adb5c68a6ad616e3', 'request_id': 'req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.688646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] The token cache is being invalidate because project 6d3547517eca4af4adb5c68a6ad616e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:22.688893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.689845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.693643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1002/2002] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:22 2022] DELETE /identity/v3/projects/6d3547517eca4af4adb5c68a6ad616e3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:22.696274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f40dd-ae99-4211-a243-54fde44db300 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:22.719169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f40dd-ae99-4211-a243-54fde44db300 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:22.831751 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:22.832717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:22.833004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:22.833281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] PATH_INFO: `/v3/users/4d36c8304de5458092036bd9688fac92` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:22.834823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d36c8304de5458092036bd9688fac92)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:22.836848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:22.896908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d36c8304de5458092036bd9688fac92'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.897722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d36c8304de5458092036bd9688fac92'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.906188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d36c8304de5458092036bd9688fac92'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.908123 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d36c8304de5458092036bd9688fac92'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.917578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6e05cfe-d4e4-48c4-9759-27d891e14cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d36c8304de5458092036bd9688fac92'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:22.944574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1001/2003] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:22 2022] DELETE /identity/v3/users/4d36c8304de5458092036bd9688fac92 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:23.313757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:23.315259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:23.328331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3cc46-5d16-40b3-b758-c0bc19ab14cc admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:23.398640 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:23.399446 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:23.399775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:23.400093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] PATH_INFO: `/v3/projects/2754393bb0b64b6eab43c590c7979499` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:23.401577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2754393bb0b64b6eab43c590c7979499)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:23.403741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:23.451208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2754393bb0b64b6eab43c590c7979499', 'request_id': 'req-fc4335fd-1514-4769-bcd8-2deb2c636fe6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:23.459148 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2754393bb0b64b6eab43c590c7979499', 'request_id': 'req-fc4335fd-1514-4769-bcd8-2deb2c636fe6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:23.471883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2754393bb0b64b6eab43c590c7979499', 'request_id': 'req-fc4335fd-1514-4769-bcd8-2deb2c636fe6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:23.482982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] The token cache is being invalidate because project 2754393bb0b64b6eab43c590c7979499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:23.483315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:23.483985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fc4335fd-1514-4769-bcd8-2deb2c636fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:23.485537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1003/2004] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:23 2022] DELETE /identity/v3/projects/2754393bb0b64b6eab43c590c7979499 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:23.490668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4dded-21ff-4593-80c0-dc0e64a1938e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:23.490956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4dded-21ff-4593-80c0-dc0e64a1938e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:23.491265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4dded-21ff-4593-80c0-dc0e64a1938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:23.510875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-3ee4dded-21ff-4593-80c0-dc0e64a1938e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:23.512143 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-3ee4dded-21ff-4593-80c0-dc0e64a1938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:23.571311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1002/2005] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:23.579241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772d06-2c5a-43c0-a363-cbe5a443a0df None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:23.579535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772d06-2c5a-43c0-a363-cbe5a443a0df None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:23.579819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2772d06-2c5a-43c0-a363-cbe5a443a0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:23.601223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f2772d06-2c5a-43c0-a363-cbe5a443a0df None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:23.602459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f2772d06-2c5a-43c0-a363-cbe5a443a0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:23.610759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1004/2006] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:23.615330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4dded-21ff-4593-80c0-dc0e64a1938e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:23.626068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4dded-21ff-4593-80c0-dc0e64a1938e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:23.631604 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3257eb-a428-4434-91f1-95f1a4924dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:23.632281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3257eb-a428-4434-91f1-95f1a4924dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:23.632568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3257eb-a428-4434-91f1-95f1a4924dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:23.632853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3257eb-a428-4434-91f1-95f1a4924dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:23.633596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3257eb-a428-4434-91f1-95f1a4924dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:23.633907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3257eb-a428-4434-91f1-95f1a4924dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:23.635561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3257eb-a428-4434-91f1-95f1a4924dfb admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:23.648426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1003/2007] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:32:23.653080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2772d06-2c5a-43c0-a363-cbe5a443a0df None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:23.662637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2772d06-2c5a-43c0-a363-cbe5a443a0df None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:23.667456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4647-99a0-495c-abd8-c02be87fd5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:23.668122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4647-99a0-495c-abd8-c02be87fd5df admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:23.668409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4647-99a0-495c-abd8-c02be87fd5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:23.668685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f4647-99a0-495c-abd8-c02be87fd5df admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:23.669395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4647-99a0-495c-abd8-c02be87fd5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:23.671358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f4647-99a0-495c-abd8-c02be87fd5df admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:23.700298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1005/2008] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:23 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:23.703373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3257eb-a428-4434-91f1-95f1a4924dfb admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:23.714994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3257eb-a428-4434-91f1-95f1a4924dfb admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:23.772685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc911e2-1aa7-4181-9501-2633c45c2f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:23.773372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc911e2-1aa7-4181-9501-2633c45c2f5d admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:23.773658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc911e2-1aa7-4181-9501-2633c45c2f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:23.773938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc911e2-1aa7-4181-9501-2633c45c2f5d admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:23.774638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc911e2-1aa7-4181-9501-2633c45c2f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:23.776655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc911e2-1aa7-4181-9501-2633c45c2f5d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:23.803848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1004/2009] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:23 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:23.803973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4647-99a0-495c-abd8-c02be87fd5df admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:23.812107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f4647-99a0-495c-abd8-c02be87fd5df admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:23.817441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25182e-9f87-4098-a987-855da8fd0db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:23.818104 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25182e-9f87-4098-a987-855da8fd0db7 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:23.818553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25182e-9f87-4098-a987-855da8fd0db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:23.818829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25182e-9f87-4098-a987-855da8fd0db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:23.819599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25182e-9f87-4098-a987-855da8fd0db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:23.821235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25182e-9f87-4098-a987-855da8fd0db7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:23.833727 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1006/2010] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:23.838089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc911e2-1aa7-4181-9501-2633c45c2f5d admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:23.849538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc911e2-1aa7-4181-9501-2633c45c2f5d admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:23.856397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1a28b-61e9-429a-b616-be5405767f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:23.858678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1a28b-61e9-429a-b616-be5405767f85 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:23.858962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1a28b-61e9-429a-b616-be5405767f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:23.859275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1a28b-61e9-429a-b616-be5405767f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:23.860022 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1a28b-61e9-429a-b616-be5405767f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:23.861656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1a28b-61e9-429a-b616-be5405767f85 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:23.882004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1005/2011] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:23.885691 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25182e-9f87-4098-a987-855da8fd0db7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:23.896886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25182e-9f87-4098-a987-855da8fd0db7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:23.901969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf75a-ad20-4f58-a402-81c8ed8ce07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:23.902876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf75a-ad20-4f58-a402-81c8ed8ce07e admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:23.903257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf75a-ad20-4f58-a402-81c8ed8ce07e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:23.903473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf75a-ad20-4f58-a402-81c8ed8ce07e admin admin] PATH_INFO: `/v3/projects/c640d0d02d424dcd913154204356e7ce/users/e3b0b1e39a974d319b1d69b67818d86a/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:23.918446 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaf75a-ad20-4f58-a402-81c8ed8ce07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c640d0d02d424dcd913154204356e7ce, user_id=e3b0b1e39a974d319b1d69b67818d86a, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:23.921260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaf75a-ad20-4f58-a402-81c8ed8ce07e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:23.946935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1007/2012] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:23 2022] PUT /identity/v3/projects/c640d0d02d424dcd913154204356e7ce/users/e3b0b1e39a974d319b1d69b67818d86a/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:23.958252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a7bfe-f76a-460f-b847-885d7cb6b9a2 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:23.958812 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a7bfe-f76a-460f-b847-885d7cb6b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:23.958812 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a7bfe-f76a-460f-b847-885d7cb6b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:23.998973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-0c9a7bfe-f76a-460f-b847-885d7cb6b9a2 None None] MFA Rules not processed for user `e3b0b1e39a974d319b1d69b67818d86a`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:24.001588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0c9a7bfe-f76a-460f-b847-885d7cb6b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:24.101736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1006/2013] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:24.106247 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf75a-ad20-4f58-a402-81c8ed8ce07e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:24.174971 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf75a-ad20-4f58-a402-81c8ed8ce07e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:24.180178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2e71e-fc36-454e-8db4-3853cbc24b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:24.180868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2e71e-fc36-454e-8db4-3853cbc24b0c admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:24.181157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2e71e-fc36-454e-8db4-3853cbc24b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:24.181440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2e71e-fc36-454e-8db4-3853cbc24b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:24.182326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2e71e-fc36-454e-8db4-3853cbc24b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:24.184315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe2e71e-fc36-454e-8db4-3853cbc24b0c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:24.220227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1008/2014] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:24 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:24.224244 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a7bfe-f76a-460f-b847-885d7cb6b9a2 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:24.234927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a7bfe-f76a-460f-b847-885d7cb6b9a2 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:24.292829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb75bd-1c21-4557-bc9b-b48b04ad769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:24.293820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb75bd-1c21-4557-bc9b-b48b04ad769f admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:24.294106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb75bd-1c21-4557-bc9b-b48b04ad769f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:24.294385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb75bd-1c21-4557-bc9b-b48b04ad769f admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:24.295109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb75bd-1c21-4557-bc9b-b48b04ad769f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:24.297031 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb75bd-1c21-4557-bc9b-b48b04ad769f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:24.319530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1007/2015] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:24 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:24.323228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2e71e-fc36-454e-8db4-3853cbc24b0c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:24.334413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2e71e-fc36-454e-8db4-3853cbc24b0c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:24.339779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e6925-20ca-41b1-bdb5-55e58a1d08d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:24.340459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e6925-20ca-41b1-bdb5-55e58a1d08d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:24.340743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e6925-20ca-41b1-bdb5-55e58a1d08d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:24.341016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e6925-20ca-41b1-bdb5-55e58a1d08d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:24.341758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e6925-20ca-41b1-bdb5-55e58a1d08d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:24.343600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e6925-20ca-41b1-bdb5-55e58a1d08d4 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:24.355598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1009/2016] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:24.359850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb75bd-1c21-4557-bc9b-b48b04ad769f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:24.371689 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb75bd-1c21-4557-bc9b-b48b04ad769f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:24.376360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444e1a8-18ab-4a07-8ec9-6e5c2e374769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:24.377310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444e1a8-18ab-4a07-8ec9-6e5c2e374769 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:24.378129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444e1a8-18ab-4a07-8ec9-6e5c2e374769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:24.378404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444e1a8-18ab-4a07-8ec9-6e5c2e374769 admin admin] PATH_INFO: `/v3/projects/8b07b4a56deb4a16b59b4c910d3e6dd5/users/e2cf115daff6401c99fc80cf72478d38/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:24.394501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444e1a8-18ab-4a07-8ec9-6e5c2e374769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b07b4a56deb4a16b59b4c910d3e6dd5, user_id=e2cf115daff6401c99fc80cf72478d38, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:24.397482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444e1a8-18ab-4a07-8ec9-6e5c2e374769 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:24.412471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1008/2017] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:24 2022] PUT /identity/v3/projects/8b07b4a56deb4a16b59b4c910d3e6dd5/users/e2cf115daff6401c99fc80cf72478d38/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:24.416891 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e6925-20ca-41b1-bdb5-55e58a1d08d4 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:24.428256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e6925-20ca-41b1-bdb5-55e58a1d08d4 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:24.491151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c1811-f83b-468f-9c41-2320f6f42c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:24.491829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c1811-f83b-468f-9c41-2320f6f42c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:24.492134 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c1811-f83b-468f-9c41-2320f6f42c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:24.492415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c1811-f83b-468f-9c41-2320f6f42c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:24.493152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c1811-f83b-468f-9c41-2320f6f42c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:24.494829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c1811-f83b-468f-9c41-2320f6f42c61 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:24.505632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1010/2018] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:24.510149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444e1a8-18ab-4a07-8ec9-6e5c2e374769 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:24.521874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444e1a8-18ab-4a07-8ec9-6e5c2e374769 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:24.526757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a066834-ba0e-480a-8e3b-2d6d08f38a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:24.527767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a066834-ba0e-480a-8e3b-2d6d08f38a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:24.528049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a066834-ba0e-480a-8e3b-2d6d08f38a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:24.528325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a066834-ba0e-480a-8e3b-2d6d08f38a7e admin admin] PATH_INFO: `/v3/projects/8b07b4a56deb4a16b59b4c910d3e6dd5/users/e2cf115daff6401c99fc80cf72478d38/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:24.530337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a066834-ba0e-480a-8e3b-2d6d08f38a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b07b4a56deb4a16b59b4c910d3e6dd5, user_id=e2cf115daff6401c99fc80cf72478d38, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:24.533025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a066834-ba0e-480a-8e3b-2d6d08f38a7e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:24.544648 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1009/2019] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:24 2022] PUT /identity/v3/projects/8b07b4a56deb4a16b59b4c910d3e6dd5/users/e2cf115daff6401c99fc80cf72478d38/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:24.557323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845eef4-b7be-49f5-903f-9f62a211ce81 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:24.557769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845eef4-b7be-49f5-903f-9f62a211ce81 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:24.558132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845eef4-b7be-49f5-903f-9f62a211ce81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:24.586853 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e845eef4-b7be-49f5-903f-9f62a211ce81 None None] MFA Rules not processed for user `e2cf115daff6401c99fc80cf72478d38`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:24.588120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e845eef4-b7be-49f5-903f-9f62a211ce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:24.661919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1011/2020] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:24.673686 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a066834-ba0e-480a-8e3b-2d6d08f38a7e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:24.676136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1a066834-ba0e-480a-8e3b-2d6d08f38a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:24.738856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a066834-ba0e-480a-8e3b-2d6d08f38a7e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:24.742695 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bac337-89fa-4a22-9168-b035be38c961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:24.743402 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bac337-89fa-4a22-9168-b035be38c961 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:24.743685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bac337-89fa-4a22-9168-b035be38c961 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:24.743966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bac337-89fa-4a22-9168-b035be38c961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:24.753624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bac337-89fa-4a22-9168-b035be38c961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:24.755090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bac337-89fa-4a22-9168-b035be38c961 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:24.765048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1010/2021] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:24.861205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845eef4-b7be-49f5-903f-9f62a211ce81 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:24.863138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e845eef4-b7be-49f5-903f-9f62a211ce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:24.877293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845eef4-b7be-49f5-903f-9f62a211ce81 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:24.881877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880e526-0765-4236-90bd-a29f0e874bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:24.882547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880e526-0765-4236-90bd-a29f0e874bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:24.882928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880e526-0765-4236-90bd-a29f0e874bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:24.883282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880e526-0765-4236-90bd-a29f0e874bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:24.964487 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880e526-0765-4236-90bd-a29f0e874bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:24.965621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880e526-0765-4236-90bd-a29f0e874bf0 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:24.976656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1012/2022] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:25.643692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bac337-89fa-4a22-9168-b035be38c961 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:25.645244 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e9bac337-89fa-4a22-9168-b035be38c961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:25.775232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bac337-89fa-4a22-9168-b035be38c961 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:25.791834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:25.793453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:25.793828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:25.794138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] PATH_INFO: `/v3/users/ee92f54ae5da4f47bf38cde053a1cab1` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:25.798404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee92f54ae5da4f47bf38cde053a1cab1)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:25.808186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:25.821609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880e526-0765-4236-90bd-a29f0e874bf0 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:25.852380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880e526-0765-4236-90bd-a29f0e874bf0 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:25.860040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:25.861874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:25.862397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:25.862853 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] PATH_INFO: `/v3/users/e3b0b1e39a974d319b1d69b67818d86a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:25.865137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b0b1e39a974d319b1d69b67818d86a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:25.867617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:25.902230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee92f54ae5da4f47bf38cde053a1cab1'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:25.903212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee92f54ae5da4f47bf38cde053a1cab1'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:25.920663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee92f54ae5da4f47bf38cde053a1cab1'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:25.922143 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee92f54ae5da4f47bf38cde053a1cab1'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:25.934671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee92f54ae5da4f47bf38cde053a1cab1'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:25.940641 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b0b1e39a974d319b1d69b67818d86a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:25.949742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b0b1e39a974d319b1d69b67818d86a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:25.950934 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b0b1e39a974d319b1d69b67818d86a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:25.952346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b0b1e39a974d319b1d69b67818d86a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:25.965828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3217691b-daae-4ba1-98d5-43a78661b3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b0b1e39a974d319b1d69b67818d86a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:25.968522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1011/2023] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:25 2022] DELETE /identity/v3/users/ee92f54ae5da4f47bf38cde053a1cab1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:25.970045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:25.972315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:25.983108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1013/2024] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:25 2022] DELETE /identity/v3/users/e3b0b1e39a974d319b1d69b67818d86a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:25.985301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c9b2b-c5e8-418e-97f7-9181167a2da6 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:25.985650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c9b2b-c5e8-418e-97f7-9181167a2da6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:25.985992 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c9b2b-c5e8-418e-97f7-9181167a2da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:26.009091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-eb5c9b2b-c5e8-418e-97f7-9181167a2da6 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:26.010972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-eb5c9b2b-c5e8-418e-97f7-9181167a2da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:26.048198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0e52-3717-4cdd-9832-c55341779300 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:26.078057 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1014/2025] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:26.078057 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acba79b-6c3e-4d3d-ba67-276e52e60cdf None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:26.078057 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acba79b-6c3e-4d3d-ba67-276e52e60cdf None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:26.078057 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acba79b-6c3e-4d3d-ba67-276e52e60cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:26.095314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-9acba79b-6c3e-4d3d-ba67-276e52e60cdf None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:26.097064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9acba79b-6c3e-4d3d-ba67-276e52e60cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:26.105043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1015/2026] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:26.105875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acba79b-6c3e-4d3d-ba67-276e52e60cdf None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:26.107452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9acba79b-6c3e-4d3d-ba67-276e52e60cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:26.134198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:26.135364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:26.135662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:26.135992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] PATH_INFO: `/v3/users/83842267ac924e4487dd6c7e4eca553c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:26.137480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83842267ac924e4487dd6c7e4eca553c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:26.139906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:26.184330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acba79b-6c3e-4d3d-ba67-276e52e60cdf None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:26.191099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3257b-07db-4e4e-bf3f-83afcd9b1ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:26.191961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3257b-07db-4e4e-bf3f-83afcd9b1ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:26.192260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3257b-07db-4e4e-bf3f-83afcd9b1ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:26.192543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3257b-07db-4e4e-bf3f-83afcd9b1ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:26.201264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83842267ac924e4487dd6c7e4eca553c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.202266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83842267ac924e4487dd6c7e4eca553c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.204380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3257b-07db-4e4e-bf3f-83afcd9b1ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:26.206587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3257b-07db-4e4e-bf3f-83afcd9b1ae4 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:26.210456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83842267ac924e4487dd6c7e4eca553c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.211226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83842267ac924e4487dd6c7e4eca553c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.217860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1016/2027] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:26.218704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3257b-07db-4e4e-bf3f-83afcd9b1ae4 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:26.219623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-726c3f92-a590-4a8a-b9ec-2056a5e62b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83842267ac924e4487dd6c7e4eca553c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.228215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3257b-07db-4e4e-bf3f-83afcd9b1ae4 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:26.232025 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728998e-dc39-47ae-aa69-60f4760b8974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:26.232672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728998e-dc39-47ae-aa69-60f4760b8974 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:26.232957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728998e-dc39-47ae-aa69-60f4760b8974 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:26.233246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728998e-dc39-47ae-aa69-60f4760b8974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:26.236425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f728998e-dc39-47ae-aa69-60f4760b8974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:26.240478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1012/2028] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:25 2022] DELETE /identity/v3/users/83842267ac924e4487dd6c7e4eca553c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:26.245035 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a59735-aa1b-4050-80cf-03442c18284b None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:26.245336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a59735-aa1b-4050-80cf-03442c18284b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:26.245621 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a59735-aa1b-4050-80cf-03442c18284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:26.254139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728998e-dc39-47ae-aa69-60f4760b8974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:26.259475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728998e-dc39-47ae-aa69-60f4760b8974 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:26.265232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-61a59735-aa1b-4050-80cf-03442c18284b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:26.266641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-61a59735-aa1b-4050-80cf-03442c18284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:26.267389 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1017/2029] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:26.335926 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1013/2030] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:26.347818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728998e-dc39-47ae-aa69-60f4760b8974 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:26.349430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f728998e-dc39-47ae-aa69-60f4760b8974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:26.367564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728998e-dc39-47ae-aa69-60f4760b8974 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:26.446395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620591bd-2b7b-47f4-a089-283f74af719d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:26.447289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620591bd-2b7b-47f4-a089-283f74af719d service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:26.447580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620591bd-2b7b-47f4-a089-283f74af719d service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:26.448047 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620591bd-2b7b-47f4-a089-283f74af719d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:26.459338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620591bd-2b7b-47f4-a089-283f74af719d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:26.460815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620591bd-2b7b-47f4-a089-283f74af719d service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:26.475711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1018/2031] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:26.760812 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a59735-aa1b-4050-80cf-03442c18284b None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:26.766076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-61a59735-aa1b-4050-80cf-03442c18284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:26.775551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620591bd-2b7b-47f4-a089-283f74af719d service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:26.777884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-620591bd-2b7b-47f4-a089-283f74af719d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:26.796254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a59735-aa1b-4050-80cf-03442c18284b None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:26.802169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:26.803262 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:26.803554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:26.803838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] PATH_INFO: `/v3/projects/653cbfde64074bec959367b521063ca7` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:26.806472 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] RBAC: Authorizing `identity:delete_project(project_id=653cbfde64074bec959367b521063ca7)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:26.809189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:26.819521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620591bd-2b7b-47f4-a089-283f74af719d service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:26.831858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:26.833560 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:26.834801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:26.835257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] PATH_INFO: `/v3/projects/c640d0d02d424dcd913154204356e7ce` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:26.838603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c640d0d02d424dcd913154204356e7ce)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:26.842034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:26.884475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653cbfde64074bec959367b521063ca7', 'request_id': 'req-bfb07187-0723-4d41-8d04-08ceb5b2102e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.892209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653cbfde64074bec959367b521063ca7', 'request_id': 'req-bfb07187-0723-4d41-8d04-08ceb5b2102e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.898454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653cbfde64074bec959367b521063ca7', 'request_id': 'req-bfb07187-0723-4d41-8d04-08ceb5b2102e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.916917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] The token cache is being invalidate because project 653cbfde64074bec959367b521063ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:26.917776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.918691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.921332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1014/2032] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:26 2022] DELETE /identity/v3/projects/653cbfde64074bec959367b521063ca7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:26.928058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:26.929631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:26.930141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c640d0d02d424dcd913154204356e7ce', 'request_id': 'req-658e924a-2b08-4459-94fe-7fbaa9a4cac1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.947132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c640d0d02d424dcd913154204356e7ce', 'request_id': 'req-658e924a-2b08-4459-94fe-7fbaa9a4cac1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.956898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c640d0d02d424dcd913154204356e7ce', 'request_id': 'req-658e924a-2b08-4459-94fe-7fbaa9a4cac1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.985126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] The token cache is being invalidate because project c640d0d02d424dcd913154204356e7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:26.985873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.987380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:26.994076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1019/2033] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:26 2022] DELETE /identity/v3/projects/c640d0d02d424dcd913154204356e7ce => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:26.995504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:26.999775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:27.025658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb07187-0723-4d41-8d04-08ceb5b2102e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:27.082355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e924a-2b08-4459-94fe-7fbaa9a4cac1 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:27.087743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:27.088631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:27.088928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:27.089261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] PATH_INFO: `/v3/users/e2cf115daff6401c99fc80cf72478d38` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:27.090520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cf115daff6401c99fc80cf72478d38)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:27.092623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:27.096974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:27.097179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:27.097771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:27.098058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] PATH_INFO: `/v3/users/ee7a4a71bed848fc9e8d6366df794476` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:27.099345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7a4a71bed848fc9e8d6366df794476)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:27.101291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:27.144589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cf115daff6401c99fc80cf72478d38'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.152921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cf115daff6401c99fc80cf72478d38'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.153665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cf115daff6401c99fc80cf72478d38'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.154320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cf115daff6401c99fc80cf72478d38'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.157247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7a4a71bed848fc9e8d6366df794476'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.157247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7a4a71bed848fc9e8d6366df794476'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.163638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7a4a71bed848fc9e8d6366df794476'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.164419 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7a4a71bed848fc9e8d6366df794476'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.167285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cf115daff6401c99fc80cf72478d38'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.172503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7a4a71bed848fc9e8d6366df794476'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.183317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1020/2034] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:26 2022] DELETE /identity/v3/users/e2cf115daff6401c99fc80cf72478d38 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:27.183317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:27.183317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:27.198233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1015/2035] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:26 2022] DELETE /identity/v3/users/ee7a4a71bed848fc9e8d6366df794476 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:27.262636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f21b39-f8a5-475a-b78d-4fb4b589bbf7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:27.360035 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:27.363798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:27.364187 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:27.364673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] PATH_INFO: `/v3/projects/775a098c7d7d48739a1e9efa3a4c884a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:27.366167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=775a098c7d7d48739a1e9efa3a4c884a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:27.368444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:27.428405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775a098c7d7d48739a1e9efa3a4c884a', 'request_id': 'req-9a79989f-7930-4716-b20a-2346326503ed'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.439282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775a098c7d7d48739a1e9efa3a4c884a', 'request_id': 'req-9a79989f-7930-4716-b20a-2346326503ed'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.446760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775a098c7d7d48739a1e9efa3a4c884a', 'request_id': 'req-9a79989f-7930-4716-b20a-2346326503ed'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.460780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] The token cache is being invalidate because project 775a098c7d7d48739a1e9efa3a4c884a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:27.461071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.461764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.463462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1021/2036] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:27 2022] DELETE /identity/v3/projects/775a098c7d7d48739a1e9efa3a4c884a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:27.468032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:27.469494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:27.488734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d60ac-d021-42a0-8353-0e49177fbfa7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:27.575184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:27.576775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:27.577234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:27.577701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] PATH_INFO: `/v3/users/23b5a21b71b14b7f930daa3d63b20f42` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:27.579696 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b5a21b71b14b7f930daa3d63b20f42)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:27.583869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:27.646671 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b5a21b71b14b7f930daa3d63b20f42'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.647306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b5a21b71b14b7f930daa3d63b20f42'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.654763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b5a21b71b14b7f930daa3d63b20f42'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.655673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b5a21b71b14b7f930daa3d63b20f42'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.663643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b5a21b71b14b7f930daa3d63b20f42'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.696381 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1016/2037] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:27 2022] DELETE /identity/v3/users/23b5a21b71b14b7f930daa3d63b20f42 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:27.727122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:27.728695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:27.740435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:27.742078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:27.754464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79989f-7930-4716-b20a-2346326503ed admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:27.836875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d1740-bc4e-4977-85dd-13fab7fc72d8 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:27.846312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:27.847459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:27.847770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:27.849019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] PATH_INFO: `/v3/projects/87b7b57cff2e446c8865b5b3ca17ee8e` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:27.854756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87b7b57cff2e446c8865b5b3ca17ee8e)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:27.855160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:27.872707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:27.874967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:27.875774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:27.876446 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] PATH_INFO: `/v3/projects/8b07b4a56deb4a16b59b4c910d3e6dd5` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:27.879332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b07b4a56deb4a16b59b4c910d3e6dd5)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:27.884199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:27.920603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b7b57cff2e446c8865b5b3ca17ee8e', 'request_id': 'req-4da760be-d185-48e1-be41-0a770e5b2aa7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.933015 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b7b57cff2e446c8865b5b3ca17ee8e', 'request_id': 'req-4da760be-d185-48e1-be41-0a770e5b2aa7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.939798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b7b57cff2e446c8865b5b3ca17ee8e', 'request_id': 'req-4da760be-d185-48e1-be41-0a770e5b2aa7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.959223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b07b4a56deb4a16b59b4c910d3e6dd5', 'request_id': 'req-4078361a-9c6d-4986-a0ac-637b60910eec'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.962643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] The token cache is being invalidate because project 87b7b57cff2e446c8865b5b3ca17ee8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:27.963247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.964586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.968441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b07b4a56deb4a16b59b4c910d3e6dd5', 'request_id': 'req-4078361a-9c6d-4986-a0ac-637b60910eec'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.969394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1017/2038] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:27 2022] DELETE /identity/v3/projects/87b7b57cff2e446c8865b5b3ca17ee8e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:27.972890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:27.974848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:27.978083 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b07b4a56deb4a16b59b4c910d3e6dd5', 'request_id': 'req-4078361a-9c6d-4986-a0ac-637b60910eec'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.992343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] The token cache is being invalidate because project 8b07b4a56deb4a16b59b4c910d3e6dd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:27.993129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.993296 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4078361a-9c6d-4986-a0ac-637b60910eec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:27.995089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1022/2039] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:27 2022] DELETE /identity/v3/projects/8b07b4a56deb4a16b59b4c910d3e6dd5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:28.000654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eb687-0a76-40f6-b738-77ad4d1bb52a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.000969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eb687-0a76-40f6-b738-77ad4d1bb52a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.001228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eb687-0a76-40f6-b738-77ad4d1bb52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.027234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-448eb687-0a76-40f6-b738-77ad4d1bb52a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:28.029361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-448eb687-0a76-40f6-b738-77ad4d1bb52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:28.072018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da760be-d185-48e1-be41-0a770e5b2aa7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:28.142165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1023/2040] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:28.156225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ff13e-175e-4eb9-87ed-e7dd29c5af6c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.156602 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ff13e-175e-4eb9-87ed-e7dd29c5af6c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.157092 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ff13e-175e-4eb9-87ed-e7dd29c5af6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.185458 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:28.186360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.186652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.186931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] PATH_INFO: `/v3/users/fe95912dea8f4146af316eeb9da45a27` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.188971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe95912dea8f4146af316eeb9da45a27)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:28.189140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-169ff13e-175e-4eb9-87ed-e7dd29c5af6c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:28.190278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-169ff13e-175e-4eb9-87ed-e7dd29c5af6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:28.191537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:28.207325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1024/2041] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:28.208346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ff13e-175e-4eb9-87ed-e7dd29c5af6c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:28.220621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ff13e-175e-4eb9-87ed-e7dd29c5af6c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:28.231828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bb1d4-b40d-4fe0-a5a9-6e1e3f754f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:28.233330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bb1d4-b40d-4fe0-a5a9-6e1e3f754f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.233330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bb1d4-b40d-4fe0-a5a9-6e1e3f754f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.233330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bb1d4-b40d-4fe0-a5a9-6e1e3f754f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.233853 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bb1d4-b40d-4fe0-a5a9-6e1e3f754f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:28.234111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bb1d4-b40d-4fe0-a5a9-6e1e3f754f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:28.236657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bb1d4-b40d-4fe0-a5a9-6e1e3f754f00 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:28.263455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1025/2042] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:32:28.266087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bb1d4-b40d-4fe0-a5a9-6e1e3f754f00 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:28.277150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe95912dea8f4146af316eeb9da45a27'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.280196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe95912dea8f4146af316eeb9da45a27'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.280847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bb1d4-b40d-4fe0-a5a9-6e1e3f754f00 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:28.287256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdfcf6-0cc6-4ad5-a465-54128062f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:28.287918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdfcf6-0cc6-4ad5-a465-54128062f6ab admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.288205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdfcf6-0cc6-4ad5-a465-54128062f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.288698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdfcf6-0cc6-4ad5-a465-54128062f6ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.289470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdfcf6-0cc6-4ad5-a465-54128062f6ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:28.291574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdfcf6-0cc6-4ad5-a465-54128062f6ab admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:28.291923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe95912dea8f4146af316eeb9da45a27'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.293077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe95912dea8f4146af316eeb9da45a27'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.325399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe95912dea8f4146af316eeb9da45a27'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.348278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1026/2043] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:28 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:28.348278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdfcf6-0cc6-4ad5-a465-54128062f6ab admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:28.349580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a4bdfcf6-0cc6-4ad5-a465-54128062f6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:28.349933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1018/2044] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:27 2022] DELETE /identity/v3/users/fe95912dea8f4146af316eeb9da45a27 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:28.350790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:28.352187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:28.429056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdfcf6-0cc6-4ad5-a465-54128062f6ab admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:28.456315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe38fe9-c644-429c-8524-b9a64bc5778c admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:28.471542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e27fc-bbbc-400a-a740-0e3335d078db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:28.473701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e27fc-bbbc-400a-a740-0e3335d078db admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.474167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e27fc-bbbc-400a-a740-0e3335d078db admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.474977 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e27fc-bbbc-400a-a740-0e3335d078db admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.475685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e27fc-bbbc-400a-a740-0e3335d078db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:28.477693 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e27fc-bbbc-400a-a740-0e3335d078db admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:28.503345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:28.504986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.505107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1019/2045] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:28 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:28.505533 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.506129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] PATH_INFO: `/v3/projects/3750b6b6dafa496b82164e20da11fe2f` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.507420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3750b6b6dafa496b82164e20da11fe2f)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:28.512157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e27fc-bbbc-400a-a740-0e3335d078db admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:28.522557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:28.523253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e27fc-bbbc-400a-a740-0e3335d078db admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:28.528440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67973b7-1631-42e8-a1d5-08ecb2d30441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:28.529150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67973b7-1631-42e8-a1d5-08ecb2d30441 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.529429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67973b7-1631-42e8-a1d5-08ecb2d30441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.529709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67973b7-1631-42e8-a1d5-08ecb2d30441 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.530644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67973b7-1631-42e8-a1d5-08ecb2d30441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:28.533252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67973b7-1631-42e8-a1d5-08ecb2d30441 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:28.548457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1020/2046] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:28.550524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67973b7-1631-42e8-a1d5-08ecb2d30441 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:28.562675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67973b7-1631-42e8-a1d5-08ecb2d30441 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:28.574009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e7a1-c2a3-46e5-af9f-9acfced65b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:28.579851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e7a1-c2a3-46e5-af9f-9acfced65b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.580245 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e7a1-c2a3-46e5-af9f-9acfced65b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.580851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e7a1-c2a3-46e5-af9f-9acfced65b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.582191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5e7a1-c2a3-46e5-af9f-9acfced65b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:28.588050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5e7a1-c2a3-46e5-af9f-9acfced65b71 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:28.595059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3750b6b6dafa496b82164e20da11fe2f', 'request_id': 'req-6f7f814f-bffd-45a5-990e-f7640e85b84f'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.607069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1021/2047] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:28.610734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3750b6b6dafa496b82164e20da11fe2f', 'request_id': 'req-6f7f814f-bffd-45a5-990e-f7640e85b84f'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.612383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e7a1-c2a3-46e5-af9f-9acfced65b71 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:28.620327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3750b6b6dafa496b82164e20da11fe2f', 'request_id': 'req-6f7f814f-bffd-45a5-990e-f7640e85b84f'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.624613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e7a1-c2a3-46e5-af9f-9acfced65b71 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:28.634349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] The token cache is being invalidate because project 3750b6b6dafa496b82164e20da11fe2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:28.634642 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.635481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6f7f814f-bffd-45a5-990e-f7640e85b84f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.637320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1027/2048] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:28 2022] DELETE /identity/v3/projects/3750b6b6dafa496b82164e20da11fe2f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:28.641837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33303d26-0905-47e3-8da7-2651ce3363ca None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.642135 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33303d26-0905-47e3-8da7-2651ce3363ca None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.642412 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33303d26-0905-47e3-8da7-2651ce3363ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.669202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-33303d26-0905-47e3-8da7-2651ce3363ca None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:28.670547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-33303d26-0905-47e3-8da7-2651ce3363ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:28.688353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a104979-3cf5-4c86-84eb-0ed15125979b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:28.689293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104979-3cf5-4c86-84eb-0ed15125979b admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.689581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104979-3cf5-4c86-84eb-0ed15125979b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.690449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a104979-3cf5-4c86-84eb-0ed15125979b admin admin] PATH_INFO: `/v3/projects/f4845d879ae844b18a7460079f248591/users/da7fdf5ac16849ba98a2918ccc75f7b7/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.708245 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a104979-3cf5-4c86-84eb-0ed15125979b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4845d879ae844b18a7460079f248591, user_id=da7fdf5ac16849ba98a2918ccc75f7b7, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:28.711188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a104979-3cf5-4c86-84eb-0ed15125979b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:28.732946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1022/2049] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:28 2022] PUT /identity/v3/projects/f4845d879ae844b18a7460079f248591/users/da7fdf5ac16849ba98a2918ccc75f7b7/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:28.739959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a104979-3cf5-4c86-84eb-0ed15125979b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:28.743125 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0a104979-3cf5-4c86-84eb-0ed15125979b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:28.761072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1028/2050] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:28.762557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1545c-c3a3-4005-ae8b-7f85e787ea21 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.762852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1545c-c3a3-4005-ae8b-7f85e787ea21 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.763338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1545c-c3a3-4005-ae8b-7f85e787ea21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.790227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-1da1545c-c3a3-4005-ae8b-7f85e787ea21 None None] MFA Rules not processed for user `da7fdf5ac16849ba98a2918ccc75f7b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:28.791515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1da1545c-c3a3-4005-ae8b-7f85e787ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:28.816449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a104979-3cf5-4c86-84eb-0ed15125979b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:28.821975 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:28.823003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.824089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.824544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] PATH_INFO: `/v3/projects/e1c06d092c0743829e7ae68a484e0db0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.825788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c06d092c0743829e7ae68a484e0db0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:28.827759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:28.864794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1029/2051] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:28.867811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95953fe3-8f2d-4674-b566-01e2c3e6a8a7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.868106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95953fe3-8f2d-4674-b566-01e2c3e6a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.868388 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95953fe3-8f2d-4674-b566-01e2c3e6a8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.878058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c06d092c0743829e7ae68a484e0db0', 'request_id': 'req-eadced51-d176-4a02-be31-3e624f234919'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.889062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c06d092c0743829e7ae68a484e0db0', 'request_id': 'req-eadced51-d176-4a02-be31-3e624f234919'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.889345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-95953fe3-8f2d-4674-b566-01e2c3e6a8a7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:28.890570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-95953fe3-8f2d-4674-b566-01e2c3e6a8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:28.896077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c06d092c0743829e7ae68a484e0db0', 'request_id': 'req-eadced51-d176-4a02-be31-3e624f234919'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.912631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] The token cache is being invalidate because project e1c06d092c0743829e7ae68a484e0db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:28.913103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.914261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:28.916784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1023/2052] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:28 2022] DELETE /identity/v3/projects/e1c06d092c0743829e7ae68a484e0db0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:28.917821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:28.919265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:28.954022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1030/2053] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:28.956400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf2ee-201e-4bac-a4d8-2679df865546 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.956693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf2ee-201e-4bac-a4d8-2679df865546 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.956975 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaf2ee-201e-4bac-a4d8-2679df865546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.975565 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-eadaf2ee-201e-4bac-a4d8-2679df865546 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:28.978096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-eadaf2ee-201e-4bac-a4d8-2679df865546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:28.986114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1031/2054] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:28.987572 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaf2ee-201e-4bac-a4d8-2679df865546 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:28.992062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadced51-d176-4a02-be31-3e624f234919 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:28.996877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f48801-a94a-4607-8826-5e7ccc2c6fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:28.997573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f48801-a94a-4607-8826-5e7ccc2c6fed admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:28.997854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f48801-a94a-4607-8826-5e7ccc2c6fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:28.998129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f48801-a94a-4607-8826-5e7ccc2c6fed admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:28.998838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f48801-a94a-4607-8826-5e7ccc2c6fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.000809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f48801-a94a-4607-8826-5e7ccc2c6fed admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.007274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaf2ee-201e-4bac-a4d8-2679df865546 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.012863 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d422b4-b7eb-4b63-af95-2fb8cc21e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.013593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d422b4-b7eb-4b63-af95-2fb8cc21e97d admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.013879 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d422b4-b7eb-4b63-af95-2fb8cc21e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.014153 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d422b4-b7eb-4b63-af95-2fb8cc21e97d admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.014889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d422b4-b7eb-4b63-af95-2fb8cc21e97d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:29.015224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d422b4-b7eb-4b63-af95-2fb8cc21e97d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.016860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d422b4-b7eb-4b63-af95-2fb8cc21e97d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.029275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1032/2055] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:32:29.030596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285ad4-4c64-4071-b727-8b71f878965f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.030887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285ad4-4c64-4071-b727-8b71f878965f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.031199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09285ad4-4c64-4071-b727-8b71f878965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.038987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1024/2056] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:28 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:29.040183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f48801-a94a-4607-8826-5e7ccc2c6fed admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.051076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-09285ad4-4c64-4071-b727-8b71f878965f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:29.052325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-09285ad4-4c64-4071-b727-8b71f878965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:29.112271 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f48801-a94a-4607-8826-5e7ccc2c6fed admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.118109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4137-6541-40a2-b796-6f5f9c7ec67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.118617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4137-6541-40a2-b796-6f5f9c7ec67e admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.119399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4137-6541-40a2-b796-6f5f9c7ec67e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.119509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4137-6541-40a2-b796-6f5f9c7ec67e admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.120220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4137-6541-40a2-b796-6f5f9c7ec67e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.122236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4137-6541-40a2-b796-6f5f9c7ec67e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.140191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1033/2057] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:29.142735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09285ad4-4c64-4071-b727-8b71f878965f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.154926 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1025/2058] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:29.156169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4137-6541-40a2-b796-6f5f9c7ec67e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.163864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09285ad4-4c64-4071-b727-8b71f878965f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.233127 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4137-6541-40a2-b796-6f5f9c7ec67e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.238538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612a411-2207-4004-b687-3acc77a9f570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.239738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a411-2207-4004-b687-3acc77a9f570 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.239738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a411-2207-4004-b687-3acc77a9f570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.239961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612a411-2207-4004-b687-3acc77a9f570 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.240526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612a411-2207-4004-b687-3acc77a9f570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:29.240839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612a411-2207-4004-b687-3acc77a9f570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.242824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612a411-2207-4004-b687-3acc77a9f570 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.250896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d679-5976-453f-9d73-f1473c026d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.251699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d679-5976-453f-9d73-f1473c026d26 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.251979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d679-5976-453f-9d73-f1473c026d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.253055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d679-5976-453f-9d73-f1473c026d26 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.253764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d679-5976-453f-9d73-f1473c026d26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.256032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d679-5976-453f-9d73-f1473c026d26 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.256672 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1026/2059] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:32:29.260838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612a411-2207-4004-b687-3acc77a9f570 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.274905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612a411-2207-4004-b687-3acc77a9f570 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.283277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8065dd9-e434-47ea-8fd7-2ddfcb45e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.284966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065dd9-e434-47ea-8fd7-2ddfcb45e834 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.285374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065dd9-e434-47ea-8fd7-2ddfcb45e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.285772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8065dd9-e434-47ea-8fd7-2ddfcb45e834 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.286556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8065dd9-e434-47ea-8fd7-2ddfcb45e834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.288965 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8065dd9-e434-47ea-8fd7-2ddfcb45e834 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.290422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1034/2060] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:29.292179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d679-5976-453f-9d73-f1473c026d26 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.304541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d679-5976-453f-9d73-f1473c026d26 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.309406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fd643-43a0-4ed5-9e75-059dc80d20b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.310343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fd643-43a0-4ed5-9e75-059dc80d20b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.310549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fd643-43a0-4ed5-9e75-059dc80d20b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.310830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fd643-43a0-4ed5-9e75-059dc80d20b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.311593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fd643-43a0-4ed5-9e75-059dc80d20b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.313528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fd643-43a0-4ed5-9e75-059dc80d20b1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.321901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1027/2061] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/users => generated 283 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:29.321901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8065dd9-e434-47ea-8fd7-2ddfcb45e834 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.335742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8065dd9-e434-47ea-8fd7-2ddfcb45e834 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.342678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c79603-0976-416e-a6e4-60b29d433fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.343409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c79603-0976-416e-a6e4-60b29d433fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.343741 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c79603-0976-416e-a6e4-60b29d433fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.344063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c79603-0976-416e-a6e4-60b29d433fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.344793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c79603-0976-416e-a6e4-60b29d433fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.347488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c79603-0976-416e-a6e4-60b29d433fd0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.355498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1035/2062] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:29.356108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fd643-43a0-4ed5-9e75-059dc80d20b1 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.363382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1028/2063] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:29.364151 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c79603-0976-416e-a6e4-60b29d433fd0 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.374665 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c79603-0976-416e-a6e4-60b29d433fd0 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.453826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a03255-61c6-49d9-929d-6f4887640aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.454521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a03255-61c6-49d9-929d-6f4887640aea admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.454810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a03255-61c6-49d9-929d-6f4887640aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.455196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a03255-61c6-49d9-929d-6f4887640aea admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.460137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fd643-43a0-4ed5-9e75-059dc80d20b1 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.460285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a03255-61c6-49d9-929d-6f4887640aea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.460285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a03255-61c6-49d9-929d-6f4887640aea admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.463913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d1b19-aea8-42d0-9024-4ef4b11d612c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.464652 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d1b19-aea8-42d0-9024-4ef4b11d612c admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.464941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d1b19-aea8-42d0-9024-4ef4b11d612c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.465217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d1b19-aea8-42d0-9024-4ef4b11d612c admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.466003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d1b19-aea8-42d0-9024-4ef4b11d612c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.468226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d1b19-aea8-42d0-9024-4ef4b11d612c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.480195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1036/2064] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:29.481054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d1b19-aea8-42d0-9024-4ef4b11d612c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.484258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1029/2065] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:29.485059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a03255-61c6-49d9-929d-6f4887640aea admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.491315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d1b19-aea8-42d0-9024-4ef4b11d612c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.494975 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a03255-61c6-49d9-929d-6f4887640aea admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.496151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598954be-33f7-4529-88f8-a18d12315f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.496824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598954be-33f7-4529-88f8-a18d12315f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.497110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598954be-33f7-4529-88f8-a18d12315f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.497472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598954be-33f7-4529-88f8-a18d12315f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.498212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598954be-33f7-4529-88f8-a18d12315f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.499886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598954be-33f7-4529-88f8-a18d12315f69 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.500364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebb31-be65-4c7e-ae7f-30f85f2a7e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.501055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb31-be65-4c7e-ae7f-30f85f2a7e7d admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.501504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb31-be65-4c7e-ae7f-30f85f2a7e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.501785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb31-be65-4c7e-ae7f-30f85f2a7e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.502526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebb31-be65-4c7e-ae7f-30f85f2a7e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.504266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbebb31-be65-4c7e-ae7f-30f85f2a7e7d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.512334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1037/2066] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:29.516124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598954be-33f7-4529-88f8-a18d12315f69 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.524920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1030/2067] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:29.526368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebb31-be65-4c7e-ae7f-30f85f2a7e7d admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.527364 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598954be-33f7-4529-88f8-a18d12315f69 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.532210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562792b-5be8-4a1e-9ea7-3e96357a67bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.532882 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562792b-5be8-4a1e-9ea7-3e96357a67bd admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.533168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562792b-5be8-4a1e-9ea7-3e96357a67bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.534126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562792b-5be8-4a1e-9ea7-3e96357a67bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.534887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562792b-5be8-4a1e-9ea7-3e96357a67bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.536805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562792b-5be8-4a1e-9ea7-3e96357a67bd admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.544661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbebb31-be65-4c7e-ae7f-30f85f2a7e7d admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.548081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1038/2068] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:29.548918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562792b-5be8-4a1e-9ea7-3e96357a67bd admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.554561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa360089-1a99-4f08-89e2-33aa970fd709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.555785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa360089-1a99-4f08-89e2-33aa970fd709 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.556074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa360089-1a99-4f08-89e2-33aa970fd709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.556358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa360089-1a99-4f08-89e2-33aa970fd709 admin admin] PATH_INFO: `/v3/projects/69e503b2f92741e080e1f88a04fd746d/users/a1ebba528f46406e9be91f00cdf6d59b/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.559480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562792b-5be8-4a1e-9ea7-3e96357a67bd admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.564663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174bc9f-7bbc-4b17-b566-010140a4e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.566100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bc9f-7bbc-4b17-b566-010140a4e450 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.566383 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bc9f-7bbc-4b17-b566-010140a4e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.566657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174bc9f-7bbc-4b17-b566-010140a4e450 admin admin] PATH_INFO: `/v3/projects/5dc881cf5e2d41bfab208c9315714733/users/60773dd1b3294b0abd10ed1e22457088/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.573251 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa360089-1a99-4f08-89e2-33aa970fd709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e503b2f92741e080e1f88a04fd746d, user_id=a1ebba528f46406e9be91f00cdf6d59b, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.576200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa360089-1a99-4f08-89e2-33aa970fd709 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.586016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174bc9f-7bbc-4b17-b566-010140a4e450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc881cf5e2d41bfab208c9315714733, user_id=60773dd1b3294b0abd10ed1e22457088, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.589019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174bc9f-7bbc-4b17-b566-010140a4e450 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.600028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1031/2069] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:29 2022] PUT /identity/v3/projects/69e503b2f92741e080e1f88a04fd746d/users/a1ebba528f46406e9be91f00cdf6d59b/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:29.601578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa360089-1a99-4f08-89e2-33aa970fd709 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.614505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1039/2070] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:29 2022] PUT /identity/v3/projects/5dc881cf5e2d41bfab208c9315714733/users/60773dd1b3294b0abd10ed1e22457088/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:29.615856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed249-bc64-4b6f-b72a-8fa92a5d96b9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.616151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed249-bc64-4b6f-b72a-8fa92a5d96b9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.616432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ed249-bc64-4b6f-b72a-8fa92a5d96b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.652151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-326ed249-bc64-4b6f-b72a-8fa92a5d96b9 None None] MFA Rules not processed for user `a1ebba528f46406e9be91f00cdf6d59b`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:29.653384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-326ed249-bc64-4b6f-b72a-8fa92a5d96b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:29.684422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa360089-1a99-4f08-89e2-33aa970fd709 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.721656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1040/2071] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:29.725303 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb2d5c-c045-4612-bd4f-b1dc8ab68b90 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.725303 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb2d5c-c045-4612-bd4f-b1dc8ab68b90 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.725303 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb2d5c-c045-4612-bd4f-b1dc8ab68b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.743601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d7466-b497-4d1b-a010-3184bb2766bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.744246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d7466-b497-4d1b-a010-3184bb2766bb admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.744560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d7466-b497-4d1b-a010-3184bb2766bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.744861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d7466-b497-4d1b-a010-3184bb2766bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.745606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d7466-b497-4d1b-a010-3184bb2766bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.747555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d7466-b497-4d1b-a010-3184bb2766bb admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.752501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f4fb2d5c-c045-4612-bd4f-b1dc8ab68b90 None None] MFA Rules not processed for user `60773dd1b3294b0abd10ed1e22457088`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:29.753937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f4fb2d5c-c045-4612-bd4f-b1dc8ab68b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:29.759114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1032/2072] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:29.759956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d7466-b497-4d1b-a010-3184bb2766bb admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.769950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d7466-b497-4d1b-a010-3184bb2766bb admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.774973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cc8c4-33f3-469c-b096-ff9664babac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.775659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cc8c4-33f3-469c-b096-ff9664babac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.775938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cc8c4-33f3-469c-b096-ff9664babac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.776215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cc8c4-33f3-469c-b096-ff9664babac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.776901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cc8c4-33f3-469c-b096-ff9664babac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.778859 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cc8c4-33f3-469c-b096-ff9664babac4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.809058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1033/2073] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:29.809058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cc8c4-33f3-469c-b096-ff9664babac4 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.833683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1041/2074] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:29.835048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb2d5c-c045-4612-bd4f-b1dc8ab68b90 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.850645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb2d5c-c045-4612-bd4f-b1dc8ab68b90 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.873264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cc8c4-33f3-469c-b096-ff9664babac4 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:29.879217 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a73c61-32e1-4530-bbe3-5064b97520d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.879914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73c61-32e1-4530-bbe3-5064b97520d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.879914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73c61-32e1-4530-bbe3-5064b97520d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.879914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a73c61-32e1-4530-bbe3-5064b97520d5 admin admin] PATH_INFO: `/v3/projects/a07c4eeed3aa4eac9c7fdbc906c0a0b8/users/51b40907aacb4ef3ba2dfc822820ff70/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.896882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a73c61-32e1-4530-bbe3-5064b97520d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07c4eeed3aa4eac9c7fdbc906c0a0b8, user_id=51b40907aacb4ef3ba2dfc822820ff70, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.899647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a73c61-32e1-4530-bbe3-5064b97520d5 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.913740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1034/2075] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:29 2022] PUT /identity/v3/projects/a07c4eeed3aa4eac9c7fdbc906c0a0b8/users/51b40907aacb4ef3ba2dfc822820ff70/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:29.913932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d133943-c463-4b64-978b-177edb3f1849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:29.914699 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a73c61-32e1-4530-bbe3-5064b97520d5 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:29.916291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d133943-c463-4b64-978b-177edb3f1849 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.916838 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d133943-c463-4b64-978b-177edb3f1849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.917317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d133943-c463-4b64-978b-177edb3f1849 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.918598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d133943-c463-4b64-978b-177edb3f1849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:29.922550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d133943-c463-4b64-978b-177edb3f1849 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:29.954643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1042/2076] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:29.956513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea38f-8e6d-4126-b92e-6e2a9c0fd73f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:29.957149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea38f-8e6d-4126-b92e-6e2a9c0fd73f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:29.957149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ea38f-8e6d-4126-b92e-6e2a9c0fd73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:29.995408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c50ea38f-8e6d-4126-b92e-6e2a9c0fd73f None None] MFA Rules not processed for user `51b40907aacb4ef3ba2dfc822820ff70`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:29.996779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c50ea38f-8e6d-4126-b92e-6e2a9c0fd73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:30.039059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a73c61-32e1-4530-bbe3-5064b97520d5 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.044504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5ccc2-a8fe-4e60-bbf5-a57940eca291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.045299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5ccc2-a8fe-4e60-bbf5-a57940eca291 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.046342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5ccc2-a8fe-4e60-bbf5-a57940eca291 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.047275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5ccc2-a8fe-4e60-bbf5-a57940eca291 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.048152 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5ccc2-a8fe-4e60-bbf5-a57940eca291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.050268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5ccc2-a8fe-4e60-bbf5-a57940eca291 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.086634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1043/2077] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:30.086634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ea38f-8e6d-4126-b92e-6e2a9c0fd73f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.090644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1035/2078] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:29 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:30.091547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5ccc2-a8fe-4e60-bbf5-a57940eca291 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.112285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ea38f-8e6d-4126-b92e-6e2a9c0fd73f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.171169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5ccc2-a8fe-4e60-bbf5-a57940eca291 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.177392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce3ffb-d019-40a7-a6a1-2235b98c89f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.178095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce3ffb-d019-40a7-a6a1-2235b98c89f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.178383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce3ffb-d019-40a7-a6a1-2235b98c89f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.178668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce3ffb-d019-40a7-a6a1-2235b98c89f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.179417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce3ffb-d019-40a7-a6a1-2235b98c89f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.181379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce3ffb-d019-40a7-a6a1-2235b98c89f1 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.196091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c795ef-d0ec-4599-af11-8b469d39dd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.196928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c795ef-d0ec-4599-af11-8b469d39dd85 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.197308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c795ef-d0ec-4599-af11-8b469d39dd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.197649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c795ef-d0ec-4599-af11-8b469d39dd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.199122 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c795ef-d0ec-4599-af11-8b469d39dd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.201616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c795ef-d0ec-4599-af11-8b469d39dd85 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.219225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1044/2079] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:30.219225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c795ef-d0ec-4599-af11-8b469d39dd85 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.222742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1036/2080] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:30 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:30.224337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce3ffb-d019-40a7-a6a1-2235b98c89f1 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.230427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c795ef-d0ec-4599-af11-8b469d39dd85 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.297346 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6c12-fe0f-45d0-b8fe-3e40c1d98bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.298028 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6c12-fe0f-45d0-b8fe-3e40c1d98bdc admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.298316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6c12-fe0f-45d0-b8fe-3e40c1d98bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.298597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c6c12-fe0f-45d0-b8fe-3e40c1d98bdc admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.300367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6c12-fe0f-45d0-b8fe-3e40c1d98bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.301074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce3ffb-d019-40a7-a6a1-2235b98c89f1 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.302348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c6c12-fe0f-45d0-b8fe-3e40c1d98bdc admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.305857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d1b40-7def-49e3-b017-676c43476ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.306764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1b40-7def-49e3-b017-676c43476ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.307071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1b40-7def-49e3-b017-676c43476ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.307355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d1b40-7def-49e3-b017-676c43476ed9 admin admin] PATH_INFO: `/v3/projects/d044e476565345729b50ac5f106f391b/users/be7d02d37b3242f5914fb1d89298ea33/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.329074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d1b40-7def-49e3-b017-676c43476ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d044e476565345729b50ac5f106f391b, user_id=be7d02d37b3242f5914fb1d89298ea33, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.332557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d1b40-7def-49e3-b017-676c43476ed9 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.338075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1045/2081] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:30 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:30.338075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6c12-fe0f-45d0-b8fe-3e40c1d98bdc admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.346399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c6c12-fe0f-45d0-b8fe-3e40c1d98bdc admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.354654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1037/2082] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:30 2022] PUT /identity/v3/projects/d044e476565345729b50ac5f106f391b/users/be7d02d37b3242f5914fb1d89298ea33/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:30.354654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d1b40-7def-49e3-b017-676c43476ed9 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.436721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765f39-e9db-471e-99ab-093c134c9dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.437684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765f39-e9db-471e-99ab-093c134c9dfc admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.439413 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765f39-e9db-471e-99ab-093c134c9dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.440248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7765f39-e9db-471e-99ab-093c134c9dfc admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.440986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7765f39-e9db-471e-99ab-093c134c9dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.442972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7765f39-e9db-471e-99ab-093c134c9dfc admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.453623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d1b40-7def-49e3-b017-676c43476ed9 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.470688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6793cb-50b5-4e72-8556-92da0972d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.471530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6793cb-50b5-4e72-8556-92da0972d6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.471803 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6793cb-50b5-4e72-8556-92da0972d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.472324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6793cb-50b5-4e72-8556-92da0972d6f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.473692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6793cb-50b5-4e72-8556-92da0972d6f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.476103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6793cb-50b5-4e72-8556-92da0972d6f7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.499018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1038/2083] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:30.499018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6793cb-50b5-4e72-8556-92da0972d6f7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.504263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1046/2084] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:30 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:30.505203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765f39-e9db-471e-99ab-093c134c9dfc admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.509749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6793cb-50b5-4e72-8556-92da0972d6f7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.516676 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf30d57-0749-48a2-b430-5d522f77fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.518780 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf30d57-0749-48a2-b430-5d522f77fd24 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.519096 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf30d57-0749-48a2-b430-5d522f77fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.519377 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf30d57-0749-48a2-b430-5d522f77fd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.520222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf30d57-0749-48a2-b430-5d522f77fd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.522126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf30d57-0749-48a2-b430-5d522f77fd24 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.525679 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7765f39-e9db-471e-99ab-093c134c9dfc admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.534397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1039/2085] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:30.535630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf30d57-0749-48a2-b430-5d522f77fd24 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.537733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb9936-e6c3-440e-a86e-5e2a1d106154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.538702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb9936-e6c3-440e-a86e-5e2a1d106154 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.538991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb9936-e6c3-440e-a86e-5e2a1d106154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.539303 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb9936-e6c3-440e-a86e-5e2a1d106154 admin admin] PATH_INFO: `/v3/projects/d9b9e479933743fa940ac08b5d8f49d1/users/68d07188700a4d648f1380277f6591d2/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.546939 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf30d57-0749-48a2-b430-5d522f77fd24 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.552035 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83ee5-da92-4d6a-8843-f255e4614c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.552797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83ee5-da92-4d6a-8843-f255e4614c5b admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.553171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83ee5-da92-4d6a-8843-f255e4614c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.553517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f83ee5-da92-4d6a-8843-f255e4614c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.554318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f83ee5-da92-4d6a-8843-f255e4614c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.556187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f83ee5-da92-4d6a-8843-f255e4614c5b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.560444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb9936-e6c3-440e-a86e-5e2a1d106154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b9e479933743fa940ac08b5d8f49d1, user_id=68d07188700a4d648f1380277f6591d2, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.564176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb9936-e6c3-440e-a86e-5e2a1d106154 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.569611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1040/2086] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:30.570647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83ee5-da92-4d6a-8843-f255e4614c5b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.586700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f83ee5-da92-4d6a-8843-f255e4614c5b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.599793 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1047/2087] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:30 2022] PUT /identity/v3/projects/d9b9e479933743fa940ac08b5d8f49d1/users/68d07188700a4d648f1380277f6591d2/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:30.600559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb9936-e6c3-440e-a86e-5e2a1d106154 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.601728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b9fc9-c632-41c1-ac73-acf00f147034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.602867 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b9fc9-c632-41c1-ac73-acf00f147034 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.603173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b9fc9-c632-41c1-ac73-acf00f147034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.607679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b9fc9-c632-41c1-ac73-acf00f147034 admin admin] PATH_INFO: `/v3/projects/d044e476565345729b50ac5f106f391b/users/be7d02d37b3242f5914fb1d89298ea33/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.616101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b9fc9-c632-41c1-ac73-acf00f147034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d044e476565345729b50ac5f106f391b, user_id=be7d02d37b3242f5914fb1d89298ea33, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.626765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b9fc9-c632-41c1-ac73-acf00f147034 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.639681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1041/2088] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:30 2022] PUT /identity/v3/projects/d044e476565345729b50ac5f106f391b/users/be7d02d37b3242f5914fb1d89298ea33/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:30.645762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b9fc9-c632-41c1-ac73-acf00f147034 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.709704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb9936-e6c3-440e-a86e-5e2a1d106154 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.754641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b9fc9-c632-41c1-ac73-acf00f147034 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.761657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f02fc-c407-4e98-a323-4d7702211a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.762378 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f02fc-c407-4e98-a323-4d7702211a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.762896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f02fc-c407-4e98-a323-4d7702211a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.763371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f02fc-c407-4e98-a323-4d7702211a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.765028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f02fc-c407-4e98-a323-4d7702211a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.766683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f02fc-c407-4e98-a323-4d7702211a7a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.779164 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1042/2089] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:30.780668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69c340-4eb7-49d5-a012-dc0c724c27be None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.781057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69c340-4eb7-49d5-a012-dc0c724c27be None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.781839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69c340-4eb7-49d5-a012-dc0c724c27be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.812627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4d12-3ea8-4129-a91b-dd1b48343067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:30.813545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4d12-3ea8-4129-a91b-dd1b48343067 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:30.813882 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4d12-3ea8-4129-a91b-dd1b48343067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:30.814208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4d12-3ea8-4129-a91b-dd1b48343067 admin admin] PATH_INFO: `/v3/projects/a4867018ab514082a1379c7a1df8536f/users/6e846a3c27f8417ab6032bdab1f2013d/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:30.831727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-1f69c340-4eb7-49d5-a012-dc0c724c27be None None] MFA Rules not processed for user `be7d02d37b3242f5914fb1d89298ea33`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:30.835433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1f69c340-4eb7-49d5-a012-dc0c724c27be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:30.850988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d4d12-3ea8-4129-a91b-dd1b48343067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4867018ab514082a1379c7a1df8536f, user_id=6e846a3c27f8417ab6032bdab1f2013d, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:30.853955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d4d12-3ea8-4129-a91b-dd1b48343067 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:30.872893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1048/2090] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:30 2022] PUT /identity/v3/projects/a4867018ab514082a1379c7a1df8536f/users/6e846a3c27f8417ab6032bdab1f2013d/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:30.873852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4d12-3ea8-4129-a91b-dd1b48343067 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.949459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1043/2091] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:30.950932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69c340-4eb7-49d5-a012-dc0c724c27be None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:30.967356 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69c340-4eb7-49d5-a012-dc0c724c27be None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.988157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4d12-3ea8-4129-a91b-dd1b48343067 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:30.999106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc71b1-bfeb-4062-8053-33414d6c6c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:31.000195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc71b1-bfeb-4062-8053-33414d6c6c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:31.000553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc71b1-bfeb-4062-8053-33414d6c6c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:31.000942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc71b1-bfeb-4062-8053-33414d6c6c04 admin admin] PATH_INFO: `/v3/projects/d9b9e479933743fa940ac08b5d8f49d1/users/68d07188700a4d648f1380277f6591d2/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:31.003700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc71b1-bfeb-4062-8053-33414d6c6c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b9e479933743fa940ac08b5d8f49d1, user_id=68d07188700a4d648f1380277f6591d2, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:31.007077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc71b1-bfeb-4062-8053-33414d6c6c04 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:31.021022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1049/2092] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:30 2022] PUT /identity/v3/projects/d9b9e479933743fa940ac08b5d8f49d1/users/68d07188700a4d648f1380277f6591d2/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:31.030483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc71b1-bfeb-4062-8053-33414d6c6c04 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:31.030483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-49dc71b1-bfeb-4062-8053-33414d6c6c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:31.055309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bedbf7-8619-43b8-946e-311c7447df0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:31.059777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bedbf7-8619-43b8-946e-311c7447df0a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:31.060064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bedbf7-8619-43b8-946e-311c7447df0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:31.060343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bedbf7-8619-43b8-946e-311c7447df0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:31.061194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bedbf7-8619-43b8-946e-311c7447df0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:31.066060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bedbf7-8619-43b8-946e-311c7447df0a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:31.077320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1044/2093] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:31.079192 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc40166-3e68-469d-9031-712d89ec6868 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:31.079845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc40166-3e68-469d-9031-712d89ec6868 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:31.080326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc40166-3e68-469d-9031-712d89ec6868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:31.106687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc71b1-bfeb-4062-8053-33414d6c6c04 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:31.113020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a637-f86d-4dc6-b3d7-75a0c5c6dca6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:31.113718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a637-f86d-4dc6-b3d7-75a0c5c6dca6 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:31.114002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a637-f86d-4dc6-b3d7-75a0c5c6dca6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:31.114274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a637-f86d-4dc6-b3d7-75a0c5c6dca6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:31.116728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-26c9a637-f86d-4dc6-b3d7-75a0c5c6dca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:31.121225 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-1fc40166-3e68-469d-9031-712d89ec6868 None None] MFA Rules not processed for user `68d07188700a4d648f1380277f6591d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:31.122401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1fc40166-3e68-469d-9031-712d89ec6868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:31.196477 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9a637-f86d-4dc6-b3d7-75a0c5c6dca6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:31.197964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9a637-f86d-4dc6-b3d7-75a0c5c6dca6 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:31.217175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1045/2094] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:31 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:31.217175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc40166-3e68-469d-9031-712d89ec6868 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:31.220684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1050/2095] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:31.253179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a637-f86d-4dc6-b3d7-75a0c5c6dca6 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:31.255403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-26c9a637-f86d-4dc6-b3d7-75a0c5c6dca6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:31.273189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a637-f86d-4dc6-b3d7-75a0c5c6dca6 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:31.279401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a57f9-5733-4c41-87c6-f6e661b723fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:31.282566 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a57f9-5733-4c41-87c6-f6e661b723fd service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:31.283040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a57f9-5733-4c41-87c6-f6e661b723fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:31.284031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a57f9-5733-4c41-87c6-f6e661b723fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:31.300249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a57f9-5733-4c41-87c6-f6e661b723fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:31.303537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a57f9-5733-4c41-87c6-f6e661b723fd service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:31.305415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc40166-3e68-469d-9031-712d89ec6868 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:31.312073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf09c9-413a-44a1-b63c-89dedd52658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:31.313030 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf09c9-413a-44a1-b63c-89dedd52658a admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:31.313311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf09c9-413a-44a1-b63c-89dedd52658a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:31.313592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf09c9-413a-44a1-b63c-89dedd52658a admin admin] PATH_INFO: `/v3/projects/a4867018ab514082a1379c7a1df8536f/users/6e846a3c27f8417ab6032bdab1f2013d/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:31.317709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf09c9-413a-44a1-b63c-89dedd52658a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4867018ab514082a1379c7a1df8536f, user_id=6e846a3c27f8417ab6032bdab1f2013d, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:31.319202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1051/2096] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:31 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:31.322644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf09c9-413a-44a1-b63c-89dedd52658a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:31.341122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1046/2097] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:31 2022] PUT /identity/v3/projects/a4867018ab514082a1379c7a1df8536f/users/6e846a3c27f8417ab6032bdab1f2013d/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:31.352373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd756-f0c8-4a35-bb41-c4da1eb11a40 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:31.352848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd756-f0c8-4a35-bb41-c4da1eb11a40 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:31.353207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fd756-f0c8-4a35-bb41-c4da1eb11a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:31.388206 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-749fd756-f0c8-4a35-bb41-c4da1eb11a40 None None] MFA Rules not processed for user `6e846a3c27f8417ab6032bdab1f2013d`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:31.389603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-749fd756-f0c8-4a35-bb41-c4da1eb11a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:31.459200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf09c9-413a-44a1-b63c-89dedd52658a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:31.483763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1052/2098] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:31.531312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf09c9-413a-44a1-b63c-89dedd52658a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:31.536827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a83c53-5a47-4441-9cd8-4cea088c3b9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:31.537647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a83c53-5a47-4441-9cd8-4cea088c3b9d service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:31.537993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a83c53-5a47-4441-9cd8-4cea088c3b9d service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:31.538353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a83c53-5a47-4441-9cd8-4cea088c3b9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:31.543745 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd756-f0c8-4a35-bb41-c4da1eb11a40 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:31.555783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fd756-f0c8-4a35-bb41-c4da1eb11a40 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:31.571556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659af71-a92f-4abc-b939-48eb06138f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:31.572738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659af71-a92f-4abc-b939-48eb06138f47 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:31.573492 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659af71-a92f-4abc-b939-48eb06138f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:31.574057 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659af71-a92f-4abc-b939-48eb06138f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:31.586529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659af71-a92f-4abc-b939-48eb06138f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:31.588302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659af71-a92f-4abc-b939-48eb06138f47 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:31.604701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1053/2099] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:32:31.615713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a83c53-5a47-4441-9cd8-4cea088c3b9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:31.618345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a83c53-5a47-4441-9cd8-4cea088c3b9d service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:31.633513 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1047/2100] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:32:32.163821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659af71-a92f-4abc-b939-48eb06138f47 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:32.234803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659af71-a92f-4abc-b939-48eb06138f47 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:32.239858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:32.240707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:32.240987 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:32.241263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] PATH_INFO: `/v3/users/51b40907aacb4ef3ba2dfc822820ff70` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:32.242530 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b40907aacb4ef3ba2dfc822820ff70)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:32.244554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:32.308525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b40907aacb4ef3ba2dfc822820ff70'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:32.317842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b40907aacb4ef3ba2dfc822820ff70'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:32.318704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b40907aacb4ef3ba2dfc822820ff70'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:32.319926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b40907aacb4ef3ba2dfc822820ff70'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:32.340463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b40907aacb4ef3ba2dfc822820ff70'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:32.356374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1054/2101] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:32 2022] DELETE /identity/v3/users/51b40907aacb4ef3ba2dfc822820ff70 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:32.360805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e6b3-b28b-4ad8-af9c-57d293e03933 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:32.361322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e6b3-b28b-4ad8-af9c-57d293e03933 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:32.361445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e6b3-b28b-4ad8-af9c-57d293e03933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:32.387925 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-f824e6b3-b28b-4ad8-af9c-57d293e03933 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:32.389254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f824e6b3-b28b-4ad8-af9c-57d293e03933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:32.457845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:32.459470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:32.475435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1048/2102] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:32.485461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824e6b3-b28b-4ad8-af9c-57d293e03933 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:32.487071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f824e6b3-b28b-4ad8-af9c-57d293e03933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:32.537916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa9546-3024-4a42-b4c1-a6fbb67c81ce admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:32.544216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:32.545162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:32.545538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:32.545868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] PATH_INFO: `/v3/users/8598fc1c3131482cb8db4253d6a6aff2` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:32.547262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8598fc1c3131482cb8db4253d6a6aff2)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:32.549347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:32.557443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824e6b3-b28b-4ad8-af9c-57d293e03933 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:32.561274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8234859-4205-4864-a246-2b152229ede6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:32.561956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8234859-4205-4864-a246-2b152229ede6 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:32.562238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8234859-4205-4864-a246-2b152229ede6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:32.562519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8234859-4205-4864-a246-2b152229ede6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:32.572494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8234859-4205-4864-a246-2b152229ede6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:32.573952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8234859-4205-4864-a246-2b152229ede6 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:32.598641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1049/2103] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:32:32.603486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8598fc1c3131482cb8db4253d6a6aff2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:32.610488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8598fc1c3131482cb8db4253d6a6aff2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:32.611355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8598fc1c3131482cb8db4253d6a6aff2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:32.612688 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8598fc1c3131482cb8db4253d6a6aff2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:32.624718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8598fc1c3131482cb8db4253d6a6aff2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:32.641578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1055/2104] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:32 2022] DELETE /identity/v3/users/8598fc1c3131482cb8db4253d6a6aff2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:32.646714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b43d-02a7-4dc2-b3e3-9bc05ac65217 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:32.647010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b43d-02a7-4dc2-b3e3-9bc05ac65217 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:32.647329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4b43d-02a7-4dc2-b3e3-9bc05ac65217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:32.680507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-7fa4b43d-02a7-4dc2-b3e3-9bc05ac65217 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:32.681828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7fa4b43d-02a7-4dc2-b3e3-9bc05ac65217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:32.800291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1050/2105] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:32.808382 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:32.811271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:32.897862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0903d0a-7f2a-474f-9e0d-8daf03375916 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:32.901773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ded506-6bfa-40ca-a049-d8f5fcba80a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:32.902429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ded506-6bfa-40ca-a049-d8f5fcba80a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:32.902707 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ded506-6bfa-40ca-a049-d8f5fcba80a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:32.902980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ded506-6bfa-40ca-a049-d8f5fcba80a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:32.913396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ded506-6bfa-40ca-a049-d8f5fcba80a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:32.914851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ded506-6bfa-40ca-a049-d8f5fcba80a2 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:32.929725 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1056/2106] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:33.009020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b43d-02a7-4dc2-b3e3-9bc05ac65217 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:33.010759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7fa4b43d-02a7-4dc2-b3e3-9bc05ac65217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:33.016088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ded506-6bfa-40ca-a049-d8f5fcba80a2 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:33.017501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-01ded506-6bfa-40ca-a049-d8f5fcba80a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:33.025756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4b43d-02a7-4dc2-b3e3-9bc05ac65217 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:33.047637 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:33.048540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:33.049416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:33.049631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] PATH_INFO: `/v3/projects/a07c4eeed3aa4eac9c7fdbc906c0a0b8` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:33.051068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07c4eeed3aa4eac9c7fdbc906c0a0b8)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:33.052971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:33.109778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07c4eeed3aa4eac9c7fdbc906c0a0b8', 'request_id': 'req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:33.120243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07c4eeed3aa4eac9c7fdbc906c0a0b8', 'request_id': 'req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:33.128568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07c4eeed3aa4eac9c7fdbc906c0a0b8', 'request_id': 'req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:33.140220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ded506-6bfa-40ca-a049-d8f5fcba80a2 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:33.161146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] The token cache is being invalidate because project a07c4eeed3aa4eac9c7fdbc906c0a0b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:33.163489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:33.165526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:33.169812 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1051/2107] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:33 2022] DELETE /identity/v3/projects/a07c4eeed3aa4eac9c7fdbc906c0a0b8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:33.176306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:33.193148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:33.227621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4777d16-c6cc-4b19-b4f0-1653effbc7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:33.228292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4777d16-c6cc-4b19-b4f0-1653effbc7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:33.233292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4777d16-c6cc-4b19-b4f0-1653effbc7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:33.233508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4777d16-c6cc-4b19-b4f0-1653effbc7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:33.238138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b4777d16-c6cc-4b19-b4f0-1653effbc7c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:33.316343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909d225-fbcf-45cd-9a4b-eb811e3d9b33 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:33.322830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:33.324288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:33.324635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:33.324941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] PATH_INFO: `/v3/users/6e846a3c27f8417ab6032bdab1f2013d` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:33.326242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e846a3c27f8417ab6032bdab1f2013d)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:33.328338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:33.344343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4777d16-c6cc-4b19-b4f0-1653effbc7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:33.346775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4777d16-c6cc-4b19-b4f0-1653effbc7c1 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:33.388007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1057/2108] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:33.431869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e846a3c27f8417ab6032bdab1f2013d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:33.433184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e846a3c27f8417ab6032bdab1f2013d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:33.464697 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e846a3c27f8417ab6032bdab1f2013d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:33.468584 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e846a3c27f8417ab6032bdab1f2013d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:33.497498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e846a3c27f8417ab6032bdab1f2013d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:33.548186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1052/2109] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:33 2022] DELETE /identity/v3/users/6e846a3c27f8417ab6032bdab1f2013d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:33.759872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4777d16-c6cc-4b19-b4f0-1653effbc7c1 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:33.761690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b4777d16-c6cc-4b19-b4f0-1653effbc7c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:33.791439 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4777d16-c6cc-4b19-b4f0-1653effbc7c1 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:33.929474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:33.931287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:33.931572 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:33.932004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] PATH_INFO: `/v3/projects/de2dbdf34db041e7bfb123aab506f44d` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:33.934427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2dbdf34db041e7bfb123aab506f44d)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:33.936626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:34.012382 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2dbdf34db041e7bfb123aab506f44d', 'request_id': 'req-87e3f77f-b7d5-4808-a146-f7c97e82732f'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.023406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2dbdf34db041e7bfb123aab506f44d', 'request_id': 'req-87e3f77f-b7d5-4808-a146-f7c97e82732f'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.028893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:34.031920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:34.032781 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2dbdf34db041e7bfb123aab506f44d', 'request_id': 'req-87e3f77f-b7d5-4808-a146-f7c97e82732f'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.060144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3cfa-368b-4daa-bad0-64bc4d6d2384 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:34.062016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] The token cache is being invalidate because project de2dbdf34db041e7bfb123aab506f44d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:34.062159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.062915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.065031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1058/2110] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:33 2022] DELETE /identity/v3/projects/de2dbdf34db041e7bfb123aab506f44d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:34.070352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:34.073081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:34.148425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:34.149418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.149841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:34.150216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] PATH_INFO: `/v3/projects/a4867018ab514082a1379c7a1df8536f` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:34.151616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4867018ab514082a1379c7a1df8536f)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:34.153686 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:34.181085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3f77f-b7d5-4808-a146-f7c97e82732f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:34.186338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:34.187254 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.187784 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:34.188154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] PATH_INFO: `/v3/users/93e09989f54742e584ecba30b6e94048` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:34.190048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e09989f54742e584ecba30b6e94048)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:34.192215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:34.230837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4867018ab514082a1379c7a1df8536f', 'request_id': 'req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.238793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4867018ab514082a1379c7a1df8536f', 'request_id': 'req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.251209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4867018ab514082a1379c7a1df8536f', 'request_id': 'req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.263654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e09989f54742e584ecba30b6e94048'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.273679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] The token cache is being invalidate because project a4867018ab514082a1379c7a1df8536f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:34.274073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.277736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e09989f54742e584ecba30b6e94048'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.278265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4447c413-9fa4-4e7d-84ee-8a0879a0e52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.278473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e09989f54742e584ecba30b6e94048'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.279926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e09989f54742e584ecba30b6e94048'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.282028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1053/2111] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:34 2022] DELETE /identity/v3/projects/a4867018ab514082a1379c7a1df8536f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:34.287650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a8f1-5bfe-4fa6-ba95-7067901a1ef0 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.288344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a8f1-5bfe-4fa6-ba95-7067901a1ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:34.288344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a8f1-5bfe-4fa6-ba95-7067901a1ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:34.309843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e09989f54742e584ecba30b6e94048'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:34.317475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b446a8f1-5bfe-4fa6-ba95-7067901a1ef0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:34.318978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b446a8f1-5bfe-4fa6-ba95-7067901a1ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:34.333299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1059/2112] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:34 2022] DELETE /identity/v3/users/93e09989f54742e584ecba30b6e94048 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:34.347847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:34.349299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:34.405272 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1054/2113] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:34.407447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eab97e-bbb2-43c7-9edb-504b7710708b None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.408001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eab97e-bbb2-43c7-9edb-504b7710708b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:34.409028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eab97e-bbb2-43c7-9edb-504b7710708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:34.429471 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33654a-b9f9-45d6-87bf-863b4651b012 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:34.433889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc40b0d-e336-4679-9622-70e47906ac72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:34.434561 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc40b0d-e336-4679-9622-70e47906ac72 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.434840 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc40b0d-e336-4679-9622-70e47906ac72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:34.435141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc40b0d-e336-4679-9622-70e47906ac72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:34.437396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5bc40b0d-e336-4679-9622-70e47906ac72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:34.449532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-57eab97e-bbb2-43c7-9edb-504b7710708b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:34.452834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-57eab97e-bbb2-43c7-9edb-504b7710708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:34.576095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc40b0d-e336-4679-9622-70e47906ac72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:34.579586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc40b0d-e336-4679-9622-70e47906ac72 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:34.590245 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1055/2114] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:34.598592 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1060/2115] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:34.608015 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eab97e-bbb2-43c7-9edb-504b7710708b None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:34.634741 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eab97e-bbb2-43c7-9edb-504b7710708b None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:34.652936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945cbc6-f7a4-45f1-ae07-749f2f116ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:34.653894 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945cbc6-f7a4-45f1-ae07-749f2f116ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.653894 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945cbc6-f7a4-45f1-ae07-749f2f116ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:34.654229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945cbc6-f7a4-45f1-ae07-749f2f116ac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:34.654958 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945cbc6-f7a4-45f1-ae07-749f2f116ac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:34.655293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945cbc6-f7a4-45f1-ae07-749f2f116ac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:34.656951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945cbc6-f7a4-45f1-ae07-749f2f116ac6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:34.678703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1056/2116] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:32:34.683241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc40b0d-e336-4679-9622-70e47906ac72 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:34.698195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc40b0d-e336-4679-9622-70e47906ac72 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:34.710947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa18b6d-2f02-4418-82e8-1fcfa4004131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:34.711685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa18b6d-2f02-4418-82e8-1fcfa4004131 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.711969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa18b6d-2f02-4418-82e8-1fcfa4004131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:34.712245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa18b6d-2f02-4418-82e8-1fcfa4004131 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:34.712960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa18b6d-2f02-4418-82e8-1fcfa4004131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:34.714990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa18b6d-2f02-4418-82e8-1fcfa4004131 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:34.753035 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1061/2117] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:34 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:32:34.757865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945cbc6-f7a4-45f1-ae07-749f2f116ac6 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:34.773869 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945cbc6-f7a4-45f1-ae07-749f2f116ac6 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:34.826407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa18b6d-2f02-4418-82e8-1fcfa4004131 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:34.831702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-dfa18b6d-2f02-4418-82e8-1fcfa4004131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:34.879287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122c735-21a9-401e-a137-19179403f5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:34.880178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c735-21a9-401e-a137-19179403f5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.880828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c735-21a9-401e-a137-19179403f5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:34.881362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122c735-21a9-401e-a137-19179403f5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:34.882172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122c735-21a9-401e-a137-19179403f5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:34.885250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122c735-21a9-401e-a137-19179403f5d6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:34.917371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1057/2118] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:34 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:34.920594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122c735-21a9-401e-a137-19179403f5d6 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:34.944404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122c735-21a9-401e-a137-19179403f5d6 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:34.952973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adebe3-a0f4-4cdd-89e7-f0ffc64dad91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:34.953973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adebe3-a0f4-4cdd-89e7-f0ffc64dad91 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.954692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adebe3-a0f4-4cdd-89e7-f0ffc64dad91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:34.955145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adebe3-a0f4-4cdd-89e7-f0ffc64dad91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:34.956966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adebe3-a0f4-4cdd-89e7-f0ffc64dad91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:34.959412 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adebe3-a0f4-4cdd-89e7-f0ffc64dad91 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:34.971105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1058/2119] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:34.976174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adebe3-a0f4-4cdd-89e7-f0ffc64dad91 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:34.976619 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa18b6d-2f02-4418-82e8-1fcfa4004131 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:34.983660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:34.985117 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.985963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:34.986383 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] PATH_INFO: `/v3/projects/5815d1d9ed6f41c68b019e37eea187ef` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:34.988559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] RBAC: Authorizing `identity:delete_project(project_id=5815d1d9ed6f41c68b019e37eea187ef)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:34.992065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:34.992463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adebe3-a0f4-4cdd-89e7-f0ffc64dad91 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:34.998234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230e1fa-264a-46ce-ae79-1bd53af90821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:34.998912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230e1fa-264a-46ce-ae79-1bd53af90821 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:34.999804 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230e1fa-264a-46ce-ae79-1bd53af90821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.000369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230e1fa-264a-46ce-ae79-1bd53af90821 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.002474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230e1fa-264a-46ce-ae79-1bd53af90821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:35.004231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230e1fa-264a-46ce-ae79-1bd53af90821 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:35.021167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1059/2120] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:32:35.025319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230e1fa-264a-46ce-ae79-1bd53af90821 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:35.041691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230e1fa-264a-46ce-ae79-1bd53af90821 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:35.058925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5815d1d9ed6f41c68b019e37eea187ef', 'request_id': 'req-0c39d4fe-4ed7-4665-9b5f-69bb806377be'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:35.074456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5815d1d9ed6f41c68b019e37eea187ef', 'request_id': 'req-0c39d4fe-4ed7-4665-9b5f-69bb806377be'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:35.089052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5815d1d9ed6f41c68b019e37eea187ef', 'request_id': 'req-0c39d4fe-4ed7-4665-9b5f-69bb806377be'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:35.114398 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] The token cache is being invalidate because project 5815d1d9ed6f41c68b019e37eea187ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:35.115567 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:35.116479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0c39d4fe-4ed7-4665-9b5f-69bb806377be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:35.118833 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1062/2121] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:34 2022] DELETE /identity/v3/projects/5815d1d9ed6f41c68b019e37eea187ef => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:35.124310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0845155-be0c-4416-82cf-46a6673b97e7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.124730 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0845155-be0c-4416-82cf-46a6673b97e7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.125046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0845155-be0c-4416-82cf-46a6673b97e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.156600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f77aed-903d-47f7-913f-29e2a2967771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:35.157011 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c0845155-be0c-4416-82cf-46a6673b97e7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:35.157638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f77aed-903d-47f7-913f-29e2a2967771 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.157927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f77aed-903d-47f7-913f-29e2a2967771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.158743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f77aed-903d-47f7-913f-29e2a2967771 admin admin] PATH_INFO: `/v3/projects/2cde148e0e7a4b6fbe90a396ae1d118f/users/36868b9e22be40c7badc396b9290afe4/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.159175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c0845155-be0c-4416-82cf-46a6673b97e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:35.168806 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1063/2122] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:35.178818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd2621-19af-4259-9541-1c38f562272f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.179131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd2621-19af-4259-9541-1c38f562272f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.179550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd2621-19af-4259-9541-1c38f562272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.199155 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f77aed-903d-47f7-913f-29e2a2967771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cde148e0e7a4b6fbe90a396ae1d118f, user_id=36868b9e22be40c7badc396b9290afe4, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:35.199743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c7bd2621-19af-4259-9541-1c38f562272f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:35.201325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c7bd2621-19af-4259-9541-1c38f562272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:35.204139 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f77aed-903d-47f7-913f-29e2a2967771 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:35.213908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1064/2123] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:35.215131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd2621-19af-4259-9541-1c38f562272f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:35.230736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd2621-19af-4259-9541-1c38f562272f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:35.239864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1060/2124] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:35 2022] PUT /identity/v3/projects/2cde148e0e7a4b6fbe90a396ae1d118f/users/36868b9e22be40c7badc396b9290afe4/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:35.251313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fdeee-0733-433b-850a-e0db58d8a1ef None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.251512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fdeee-0733-433b-850a-e0db58d8a1ef None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.251796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fdeee-0733-433b-850a-e0db58d8a1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.289674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-1a8fdeee-0733-433b-850a-e0db58d8a1ef None None] MFA Rules not processed for user `36868b9e22be40c7badc396b9290afe4`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:35.291233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1a8fdeee-0733-433b-850a-e0db58d8a1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:35.350511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c9250-cdfb-4781-8ccd-5784bd962b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:35.351628 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c9250-cdfb-4781-8ccd-5784bd962b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.351920 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c9250-cdfb-4781-8ccd-5784bd962b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.352286 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c9250-cdfb-4781-8ccd-5784bd962b8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.353136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c9250-cdfb-4781-8ccd-5784bd962b8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:35.353458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c9250-cdfb-4781-8ccd-5784bd962b8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:35.355742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c9250-cdfb-4781-8ccd-5784bd962b8f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:35.375832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1065/2125] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:32:35.381222 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c9250-cdfb-4781-8ccd-5784bd962b8f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:35.401680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c9250-cdfb-4781-8ccd-5784bd962b8f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:35.417033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e3b71-dd5c-4452-ada7-83a58f1e833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:35.426117 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e3b71-dd5c-4452-ada7-83a58f1e833b admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.426548 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e3b71-dd5c-4452-ada7-83a58f1e833b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.426827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e3b71-dd5c-4452-ada7-83a58f1e833b admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.429182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1061/2126] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:35.429376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e3b71-dd5c-4452-ada7-83a58f1e833b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:35.432861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e3b71-dd5c-4452-ada7-83a58f1e833b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:35.443453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fdeee-0733-433b-850a-e0db58d8a1ef None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:35.445022 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1a8fdeee-0733-433b-850a-e0db58d8a1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:35.486992 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1066/2127] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:35 2022] POST /identity/v3/projects => generated 409 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:32:35.491054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e3b71-dd5c-4452-ada7-83a58f1e833b admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:35.534928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fdeee-0733-433b-850a-e0db58d8a1ef None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:35.606844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e3b71-dd5c-4452-ada7-83a58f1e833b admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:35.613290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604310d8-284a-4754-aa5b-e224eb2e0db3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:35.613642 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e09be-817f-4a0d-a5d3-29ba30b9c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:35.614030 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604310d8-284a-4754-aa5b-e224eb2e0db3 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.614464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604310d8-284a-4754-aa5b-e224eb2e0db3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.614636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e09be-817f-4a0d-a5d3-29ba30b9c963 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.614891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604310d8-284a-4754-aa5b-e224eb2e0db3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.615006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e09be-817f-4a0d-a5d3-29ba30b9c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.615423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e09be-817f-4a0d-a5d3-29ba30b9c963 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.616128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e09be-817f-4a0d-a5d3-29ba30b9c963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:35.618210 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e09be-817f-4a0d-a5d3-29ba30b9c963 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:35.651999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1067/2128] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:35 2022] POST /identity/v3/users => generated 305 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:32:35.654973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e09be-817f-4a0d-a5d3-29ba30b9c963 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:35.674981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e09be-817f-4a0d-a5d3-29ba30b9c963 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:35.685367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7f6e8-0c51-4f71-9e25-4ced805c3c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:35.686689 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f6e8-0c51-4f71-9e25-4ced805c3c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.687187 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f6e8-0c51-4f71-9e25-4ced805c3c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.687674 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f6e8-0c51-4f71-9e25-4ced805c3c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.688614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7f6e8-0c51-4f71-9e25-4ced805c3c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:35.692698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7f6e8-0c51-4f71-9e25-4ced805c3c99 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:35.693233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604310d8-284a-4754-aa5b-e224eb2e0db3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:35.694904 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604310d8-284a-4754-aa5b-e224eb2e0db3 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:35.711991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1068/2129] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:32:35.716380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7f6e8-0c51-4f71-9e25-4ced805c3c99 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:35.720577 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1062/2130] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:32:35.733582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7f6e8-0c51-4f71-9e25-4ced805c3c99 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:35.735975 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604310d8-284a-4754-aa5b-e224eb2e0db3 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:35.738850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-604310d8-284a-4754-aa5b-e224eb2e0db3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:35.747705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124a03e-e60c-430a-ab2a-b1043faa63d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:35.747705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124a03e-e60c-430a-ab2a-b1043faa63d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.748245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124a03e-e60c-430a-ab2a-b1043faa63d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.748479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124a03e-e60c-430a-ab2a-b1043faa63d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.749227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124a03e-e60c-430a-ab2a-b1043faa63d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:35.750857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124a03e-e60c-430a-ab2a-b1043faa63d8 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:35.762849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1069/2131] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:35.764729 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604310d8-284a-4754-aa5b-e224eb2e0db3 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:35.767231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124a03e-e60c-430a-ab2a-b1043faa63d8 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:35.779072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:35.780415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.780919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.781382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] PATH_INFO: `/v3/users/36868b9e22be40c7badc396b9290afe4` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.781846 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124a03e-e60c-430a-ab2a-b1043faa63d8 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:35.783702 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=36868b9e22be40c7badc396b9290afe4)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:35.786143 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:35.801622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aad436-5dd3-483b-a608-202fe2dfa84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:35.802532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aad436-5dd3-483b-a608-202fe2dfa84b admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.805551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aad436-5dd3-483b-a608-202fe2dfa84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.805894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aad436-5dd3-483b-a608-202fe2dfa84b admin admin] PATH_INFO: `/v3/projects/e662cf5ddd744394b9cc8df77cc6ab30/users/5b1d0db1a20044028b5bb1ded52615d1/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.850682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aad436-5dd3-483b-a608-202fe2dfa84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e662cf5ddd744394b9cc8df77cc6ab30, user_id=5b1d0db1a20044028b5bb1ded52615d1, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:35.854193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aad436-5dd3-483b-a608-202fe2dfa84b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:35.883637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1070/2132] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:35 2022] PUT /identity/v3/projects/e662cf5ddd744394b9cc8df77cc6ab30/users/5b1d0db1a20044028b5bb1ded52615d1/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:35.890607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36868b9e22be40c7badc396b9290afe4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:35.891831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36868b9e22be40c7badc396b9290afe4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:35.895042 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3924dbf-4aef-4a42-922c-d84585ff3546 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.895361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3924dbf-4aef-4a42-922c-d84585ff3546 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.895646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3924dbf-4aef-4a42-922c-d84585ff3546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.901389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36868b9e22be40c7badc396b9290afe4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:35.902586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36868b9e22be40c7badc396b9290afe4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:35.912457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d7985eab-31ac-43be-9036-06f447aaf8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36868b9e22be40c7badc396b9290afe4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:35.938914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a3924dbf-4aef-4a42-922c-d84585ff3546 None None] MFA Rules not processed for user `5b1d0db1a20044028b5bb1ded52615d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:35.940645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a3924dbf-4aef-4a42-922c-d84585ff3546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:35.956954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1063/2133] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:35 2022] DELETE /identity/v3/users/36868b9e22be40c7badc396b9290afe4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:35.961915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d47d1-33f0-4e88-8821-fa38d66b7a01 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:35.962238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d47d1-33f0-4e88-8821-fa38d66b7a01 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:35.962474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d47d1-33f0-4e88-8821-fa38d66b7a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:35.985335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-7c2d47d1-33f0-4e88-8821-fa38d66b7a01 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:35.987081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7c2d47d1-33f0-4e88-8821-fa38d66b7a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:36.032607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1071/2134] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:36.037611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3924dbf-4aef-4a42-922c-d84585ff3546 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:36.039240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a3924dbf-4aef-4a42-922c-d84585ff3546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:36.075825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1064/2135] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:36.087635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d47d1-33f0-4e88-8821-fa38d66b7a01 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:36.090845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7c2d47d1-33f0-4e88-8821-fa38d66b7a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:36.145128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3924dbf-4aef-4a42-922c-d84585ff3546 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:36.151109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd4f4-5a71-41ed-94fd-f99366e77aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:36.165137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd4f4-5a71-41ed-94fd-f99366e77aff admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:36.165476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd4f4-5a71-41ed-94fd-f99366e77aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:36.165748 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd4f4-5a71-41ed-94fd-f99366e77aff admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:36.166787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd4f4-5a71-41ed-94fd-f99366e77aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:36.168957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd4f4-5a71-41ed-94fd-f99366e77aff admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:36.186310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d47d1-33f0-4e88-8821-fa38d66b7a01 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:36.190545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5578-471b-468d-b552-45a6ac3d8903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:36.191341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5578-471b-468d-b552-45a6ac3d8903 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:36.191763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5578-471b-468d-b552-45a6ac3d8903 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:36.192124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5578-471b-468d-b552-45a6ac3d8903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:36.209211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1072/2136] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:36 2022] POST /identity/v3/projects => generated 407 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:36.210838 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd4f4-5a71-41ed-94fd-f99366e77aff admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:36.214183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d5578-471b-468d-b552-45a6ac3d8903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:36.215706 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d5578-471b-468d-b552-45a6ac3d8903 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:36.232721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1065/2137] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:36.291322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd4f4-5a71-41ed-94fd-f99366e77aff admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:36.300651 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3b431-10cc-4188-be8c-220d8982622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:36.301587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3b431-10cc-4188-be8c-220d8982622d admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:36.302230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3b431-10cc-4188-be8c-220d8982622d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:36.302455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3b431-10cc-4188-be8c-220d8982622d admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:36.303899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3b431-10cc-4188-be8c-220d8982622d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:36.307430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3b431-10cc-4188-be8c-220d8982622d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:36.346170 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1073/2138] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:36 2022] POST /identity/v3/users => generated 310 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:32:36.350611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5578-471b-468d-b552-45a6ac3d8903 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:36.377655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5578-471b-468d-b552-45a6ac3d8903 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:36.394429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06775e-88a1-4ed3-bc6d-8dd0556f749d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:36.394993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06775e-88a1-4ed3-bc6d-8dd0556f749d admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:36.395376 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06775e-88a1-4ed3-bc6d-8dd0556f749d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:36.395767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06775e-88a1-4ed3-bc6d-8dd0556f749d admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:36.396540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06775e-88a1-4ed3-bc6d-8dd0556f749d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:36.399184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06775e-88a1-4ed3-bc6d-8dd0556f749d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:36.423668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1066/2139] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:36.428736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3b431-10cc-4188-be8c-220d8982622d admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:36.450140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3b431-10cc-4188-be8c-220d8982622d admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:36.457282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5ade4-21ed-4868-9268-9a2420651f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:36.458208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5ade4-21ed-4868-9268-9a2420651f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:36.458496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5ade4-21ed-4868-9268-9a2420651f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:36.458779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5ade4-21ed-4868-9268-9a2420651f6c admin admin] PATH_INFO: `/v3/projects/9e46628a43aa4c8eb2c2e7afa411ac6c/users/2c792cfe829648afa96656b9f92028ed/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:36.495482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5ade4-21ed-4868-9268-9a2420651f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e46628a43aa4c8eb2c2e7afa411ac6c, user_id=2c792cfe829648afa96656b9f92028ed, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:36.505712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5ade4-21ed-4868-9268-9a2420651f6c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:36.535344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1074/2140] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:36 2022] PUT /identity/v3/projects/9e46628a43aa4c8eb2c2e7afa411ac6c/users/2c792cfe829648afa96656b9f92028ed/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:36.538017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06775e-88a1-4ed3-bc6d-8dd0556f749d admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:36.551517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06775e-88a1-4ed3-bc6d-8dd0556f749d admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:36.718168 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4dc31-8c1f-49db-8970-53227b4fd680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:36.719262 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4dc31-8c1f-49db-8970-53227b4fd680 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:36.719613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4dc31-8c1f-49db-8970-53227b4fd680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:36.719971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4dc31-8c1f-49db-8970-53227b4fd680 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:36.722638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4dc31-8c1f-49db-8970-53227b4fd680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:36.723579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4dc31-8c1f-49db-8970-53227b4fd680 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:36.750689 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1067/2141] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:32:36.756816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5ade4-21ed-4868-9268-9a2420651f6c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:36.758727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4dc31-8c1f-49db-8970-53227b4fd680 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:36.762570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-19c4dc31-8c1f-49db-8970-53227b4fd680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:36.780473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5ade4-21ed-4868-9268-9a2420651f6c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:36.796528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4dc31-8c1f-49db-8970-53227b4fd680 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:36.797597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a498469-a8ac-45af-9601-e6c476d75207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:36.801514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498469-a8ac-45af-9601-e6c476d75207 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:36.803810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498469-a8ac-45af-9601-e6c476d75207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:36.804959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a498469-a8ac-45af-9601-e6c476d75207 admin admin] PATH_INFO: `/v3/projects/9e46628a43aa4c8eb2c2e7afa411ac6c/users/2c792cfe829648afa96656b9f92028ed/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:36.808857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a498469-a8ac-45af-9601-e6c476d75207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e46628a43aa4c8eb2c2e7afa411ac6c, user_id=2c792cfe829648afa96656b9f92028ed, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:36.817420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a498469-a8ac-45af-9601-e6c476d75207 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:36.823304 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:36.824188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:36.824475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:36.824752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] PATH_INFO: `/v3/projects/2cde148e0e7a4b6fbe90a396ae1d118f` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:36.826740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cde148e0e7a4b6fbe90a396ae1d118f)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:36.829506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:36.844651 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1075/2142] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:36 2022] PUT /identity/v3/projects/9e46628a43aa4c8eb2c2e7afa411ac6c/users/2c792cfe829648afa96656b9f92028ed/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:36.857052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac673a-e18c-4983-b0a6-a20b94c6a603 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:36.857348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac673a-e18c-4983-b0a6-a20b94c6a603 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:36.857630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac673a-e18c-4983-b0a6-a20b94c6a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:36.919949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cde148e0e7a4b6fbe90a396ae1d118f', 'request_id': 'req-b20724f1-f9fb-4613-8c30-47d929f91104'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:36.922198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a8ac673a-e18c-4983-b0a6-a20b94c6a603 None None] MFA Rules not processed for user `2c792cfe829648afa96656b9f92028ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:36.924473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a8ac673a-e18c-4983-b0a6-a20b94c6a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:36.942821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cde148e0e7a4b6fbe90a396ae1d118f', 'request_id': 'req-b20724f1-f9fb-4613-8c30-47d929f91104'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:36.959888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cde148e0e7a4b6fbe90a396ae1d118f', 'request_id': 'req-b20724f1-f9fb-4613-8c30-47d929f91104'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:36.978567 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] The token cache is being invalidate because project 2cde148e0e7a4b6fbe90a396ae1d118f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:36.978860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:36.979577 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b20724f1-f9fb-4613-8c30-47d929f91104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:36.982751 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1068/2143] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:36 2022] DELETE /identity/v3/projects/2cde148e0e7a4b6fbe90a396ae1d118f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:36.988759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668e548-9c6b-4387-9fec-eb723c4c15e2 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:36.989187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668e548-9c6b-4387-9fec-eb723c4c15e2 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:36.989555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668e548-9c6b-4387-9fec-eb723c4c15e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.012220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-f668e548-9c6b-4387-9fec-eb723c4c15e2 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:37.013459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f668e548-9c6b-4387-9fec-eb723c4c15e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:37.050125 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1076/2144] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:37.058276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac673a-e18c-4983-b0a6-a20b94c6a603 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:37.060119 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a8ac673a-e18c-4983-b0a6-a20b94c6a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:37.094645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1069/2145] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:37.103107 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695382c-87e7-40ba-b585-47f929949ab8 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.103550 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695382c-87e7-40ba-b585-47f929949ab8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.103977 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695382c-87e7-40ba-b585-47f929949ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.128740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5695382c-87e7-40ba-b585-47f929949ab8 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:37.129623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5695382c-87e7-40ba-b585-47f929949ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:37.139339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1070/2146] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:37.143279 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695382c-87e7-40ba-b585-47f929949ab8 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:37.153219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac673a-e18c-4983-b0a6-a20b94c6a603 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:37.155372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695382c-87e7-40ba-b585-47f929949ab8 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:37.159758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5139cbb-f3da-4958-9e8f-c8cebfbfeedf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:37.160467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5139cbb-f3da-4958-9e8f-c8cebfbfeedf service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.160724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5139cbb-f3da-4958-9e8f-c8cebfbfeedf service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.161007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5139cbb-f3da-4958-9e8f-c8cebfbfeedf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.162485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08a04-aa92-4411-9c1c-1d2f22b96545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:37.163200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08a04-aa92-4411-9c1c-1d2f22b96545 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.163486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08a04-aa92-4411-9c1c-1d2f22b96545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.163757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08a04-aa92-4411-9c1c-1d2f22b96545 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.164567 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08a04-aa92-4411-9c1c-1d2f22b96545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:37.164884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08a04-aa92-4411-9c1c-1d2f22b96545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:37.166568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08a04-aa92-4411-9c1c-1d2f22b96545 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:37.175631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5139cbb-f3da-4958-9e8f-c8cebfbfeedf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:37.177478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5139cbb-f3da-4958-9e8f-c8cebfbfeedf service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:37.186075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1071/2147] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:32:37.186825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08a04-aa92-4411-9c1c-1d2f22b96545 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:37.189022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1077/2148] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:37 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:32:37.214362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08a04-aa92-4411-9c1c-1d2f22b96545 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:37.221700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea2561-4b18-47ee-b92d-ec7b61b8a6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:37.223622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2561-4b18-47ee-b92d-ec7b61b8a6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.224021 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2561-4b18-47ee-b92d-ec7b61b8a6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.224523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2561-4b18-47ee-b92d-ec7b61b8a6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.225380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea2561-4b18-47ee-b92d-ec7b61b8a6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:37.228954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea2561-4b18-47ee-b92d-ec7b61b8a6b3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:37.296163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1072/2149] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:37 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:37.298477 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5139cbb-f3da-4958-9e8f-c8cebfbfeedf service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:37.327309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5139cbb-f3da-4958-9e8f-c8cebfbfeedf service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:37.457889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea2561-4b18-47ee-b92d-ec7b61b8a6b3 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:37.460162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e6ea2561-4b18-47ee-b92d-ec7b61b8a6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:37.470408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fc86b-ef74-4906-bf7e-4e0043149f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:37.471172 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fc86b-ef74-4906-bf7e-4e0043149f4b admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.471462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fc86b-ef74-4906-bf7e-4e0043149f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.471733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08fc86b-ef74-4906-bf7e-4e0043149f4b admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.472464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fc86b-ef74-4906-bf7e-4e0043149f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:37.474405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08fc86b-ef74-4906-bf7e-4e0043149f4b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:37.510113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1078/2150] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:37 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:37.511994 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fc86b-ef74-4906-bf7e-4e0043149f4b admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:37.524895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08fc86b-ef74-4906-bf7e-4e0043149f4b admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:37.532666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b667c-bd2e-46d2-a223-12761d6f01a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:37.534473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b667c-bd2e-46d2-a223-12761d6f01a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.534876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b667c-bd2e-46d2-a223-12761d6f01a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.535196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b667c-bd2e-46d2-a223-12761d6f01a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.536089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b667c-bd2e-46d2-a223-12761d6f01a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:37.537742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b667c-bd2e-46d2-a223-12761d6f01a0 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:37.538803 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea2561-4b18-47ee-b92d-ec7b61b8a6b3 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:37.548350 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca374823-2430-462d-bdf1-578b25160e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:37.552851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374823-2430-462d-bdf1-578b25160e8f service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.553007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1079/2151] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:37.553089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374823-2430-462d-bdf1-578b25160e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.553089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374823-2430-462d-bdf1-578b25160e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.553248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23b66-6a7b-4a59-973a-15cd82a70f46 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.553248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23b66-6a7b-4a59-973a-15cd82a70f46 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.553248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b23b66-6a7b-4a59-973a-15cd82a70f46 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.553432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1080/2152] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:32:37.554209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b23b66-6a7b-4a59-973a-15cd82a70f46 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:37.556108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ca374823-2430-462d-bdf1-578b25160e8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:37.574933 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b23b66-6a7b-4a59-973a-15cd82a70f46 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:37.584430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a795e07-3e8e-4829-8cef-b163c2d4191e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:37.585165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795e07-3e8e-4829-8cef-b163c2d4191e admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.585561 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795e07-3e8e-4829-8cef-b163c2d4191e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.585750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a795e07-3e8e-4829-8cef-b163c2d4191e admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.587357 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a795e07-3e8e-4829-8cef-b163c2d4191e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:37.589425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a795e07-3e8e-4829-8cef-b163c2d4191e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:37.605672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1081/2153] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:37.605672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83592c4-a569-4d26-99e4-b201971f85aa None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.605672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83592c4-a569-4d26-99e4-b201971f85aa None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.605672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83592c4-a569-4d26-99e4-b201971f85aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.626466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca374823-2430-462d-bdf1-578b25160e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:37.628584 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca374823-2430-462d-bdf1-578b25160e8f service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:37.636468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e83592c4-a569-4d26-99e4-b201971f85aa None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:37.638105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e83592c4-a569-4d26-99e4-b201971f85aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:37.639110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1073/2154] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:37.639973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca374823-2430-462d-bdf1-578b25160e8f service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:37.651324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca374823-2430-462d-bdf1-578b25160e8f service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:37.660179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0fc61-5705-4a49-abd5-4f865b306389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:37.661199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fc61-5705-4a49-abd5-4f865b306389 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.661567 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fc61-5705-4a49-abd5-4f865b306389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.661918 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0fc61-5705-4a49-abd5-4f865b306389 admin admin] PATH_INFO: `/v3/projects/4e5a70e3c2b748f0acd43ccfa1a1e84b/users/9f8f789679314a459002014bdc30b614/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.694116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0fc61-5705-4a49-abd5-4f865b306389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5a70e3c2b748f0acd43ccfa1a1e84b, user_id=9f8f789679314a459002014bdc30b614, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:37.698104 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0fc61-5705-4a49-abd5-4f865b306389 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:37.765382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1074/2155] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:37 2022] PUT /identity/v3/projects/4e5a70e3c2b748f0acd43ccfa1a1e84b/users/9f8f789679314a459002014bdc30b614/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:37.767356 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe964d-0107-48cc-bd5f-c0fefdf3ad28 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.768191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe964d-0107-48cc-bd5f-c0fefdf3ad28 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.768476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe964d-0107-48cc-bd5f-c0fefdf3ad28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.790903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1082/2156] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:37.797271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83592c4-a569-4d26-99e4-b201971f85aa None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:37.799737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e83592c4-a569-4d26-99e4-b201971f85aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:37.827376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83592c4-a569-4d26-99e4-b201971f85aa None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:37.835764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-befe964d-0107-48cc-bd5f-c0fefdf3ad28 None None] MFA Rules not processed for user `9f8f789679314a459002014bdc30b614`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:37.838327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-befe964d-0107-48cc-bd5f-c0fefdf3ad28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:37.970856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb42d1-c3a8-41f2-b835-7fb2c729b667 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:37.971800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb42d1-c3a8-41f2-b835-7fb2c729b667 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:37.972097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb42d1-c3a8-41f2-b835-7fb2c729b667 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:37.972374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb42d1-c3a8-41f2-b835-7fb2c729b667 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:37.988219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb42d1-c3a8-41f2-b835-7fb2c729b667 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:37.990285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1075/2157] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:37.990531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb42d1-c3a8-41f2-b835-7fb2c729b667 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:38.003798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe964d-0107-48cc-bd5f-c0fefdf3ad28 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:38.011074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1083/2158] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:38.093522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe964d-0107-48cc-bd5f-c0fefdf3ad28 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:38.097571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9fc68-9f5f-41fa-b765-806dd3fb6193 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:38.098187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9fc68-9f5f-41fa-b765-806dd3fb6193 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:38.098468 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9fc68-9f5f-41fa-b765-806dd3fb6193 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:38.099266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9fc68-9f5f-41fa-b765-806dd3fb6193 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:38.110541 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9fc68-9f5f-41fa-b765-806dd3fb6193 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:38.112776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9fc68-9f5f-41fa-b765-806dd3fb6193 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:38.144900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1076/2159] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:32:38.166009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb42d1-c3a8-41f2-b835-7fb2c729b667 service nova] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:38.252549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb42d1-c3a8-41f2-b835-7fb2c729b667 service nova] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:38.258054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:38.262053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:38.262053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:38.262053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] PATH_INFO: `/v3/users/9f8f789679314a459002014bdc30b614` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:38.262053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8f789679314a459002014bdc30b614)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:38.263316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:38.328627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8f789679314a459002014bdc30b614'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:38.335509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8f789679314a459002014bdc30b614'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:38.336216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8f789679314a459002014bdc30b614'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:38.336856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8f789679314a459002014bdc30b614'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:38.350390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8f789679314a459002014bdc30b614'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:38.367158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1084/2160] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:38 2022] DELETE /identity/v3/users/9f8f789679314a459002014bdc30b614 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:38.373653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a1ac-14f7-4ee7-a5c2-794ea3bc7d34 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:38.374256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a1ac-14f7-4ee7-a5c2-794ea3bc7d34 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:38.374718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585a1ac-14f7-4ee7-a5c2-794ea3bc7d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:38.400026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c585a1ac-14f7-4ee7-a5c2-794ea3bc7d34 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:38.400026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c585a1ac-14f7-4ee7-a5c2-794ea3bc7d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:38.469298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1077/2161] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:38.480076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:38.481580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:38.543252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e36484-69b0-486e-9525-c0e12f7c40cd admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:38.547553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f483f-1288-4f88-b3da-bae97658dfb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:38.548227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f483f-1288-4f88-b3da-bae97658dfb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:38.548515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f483f-1288-4f88-b3da-bae97658dfb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:38.549441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f483f-1288-4f88-b3da-bae97658dfb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:38.559562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f483f-1288-4f88-b3da-bae97658dfb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:38.561024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f483f-1288-4f88-b3da-bae97658dfb9 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:38.571952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1085/2162] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:38.883724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585a1ac-14f7-4ee7-a5c2-794ea3bc7d34 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:38.885358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c585a1ac-14f7-4ee7-a5c2-794ea3bc7d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:38.909883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585a1ac-14f7-4ee7-a5c2-794ea3bc7d34 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:38.915260 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72710f23-c639-446a-803d-8819552252cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:38.916200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72710f23-c639-446a-803d-8819552252cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:38.916482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72710f23-c639-446a-803d-8819552252cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:38.916773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72710f23-c639-446a-803d-8819552252cc admin admin] PATH_INFO: `/v3/projects/4e5a70e3c2b748f0acd43ccfa1a1e84b` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:38.918051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72710f23-c639-446a-803d-8819552252cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5a70e3c2b748f0acd43ccfa1a1e84b)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:38.920036 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72710f23-c639-446a-803d-8819552252cc admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:38.992301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-72710f23-c639-446a-803d-8819552252cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5a70e3c2b748f0acd43ccfa1a1e84b', 'request_id': 'req-72710f23-c639-446a-803d-8819552252cc'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:39.004868 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-72710f23-c639-446a-803d-8819552252cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5a70e3c2b748f0acd43ccfa1a1e84b', 'request_id': 'req-72710f23-c639-446a-803d-8819552252cc'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:39.013042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-72710f23-c639-446a-803d-8819552252cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5a70e3c2b748f0acd43ccfa1a1e84b', 'request_id': 'req-72710f23-c639-446a-803d-8819552252cc'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:39.033238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-72710f23-c639-446a-803d-8819552252cc admin admin] The token cache is being invalidate because project 4e5a70e3c2b748f0acd43ccfa1a1e84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:39.033578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-72710f23-c639-446a-803d-8819552252cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:39.035648 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-72710f23-c639-446a-803d-8819552252cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:39.037435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1078/2163] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:38 2022] DELETE /identity/v3/projects/4e5a70e3c2b748f0acd43ccfa1a1e84b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:39.042374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6f119-b706-4a7f-b699-5ecca35c7e2c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:39.042666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6f119-b706-4a7f-b699-5ecca35c7e2c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:39.042948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6f119-b706-4a7f-b699-5ecca35c7e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:39.070797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-5bc6f119-b706-4a7f-b699-5ecca35c7e2c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:39.072992 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5bc6f119-b706-4a7f-b699-5ecca35c7e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:39.144814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1086/2164] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:39.153849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197b1ec-2907-43b3-964f-c8718254a1a0 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:39.154200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197b1ec-2907-43b3-964f-c8718254a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:39.154488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197b1ec-2907-43b3-964f-c8718254a1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:39.180245 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5197b1ec-2907-43b3-964f-c8718254a1a0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:39.181486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5197b1ec-2907-43b3-964f-c8718254a1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:39.191383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1079/2165] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:39.197323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6f119-b706-4a7f-b699-5ecca35c7e2c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:39.212455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6f119-b706-4a7f-b699-5ecca35c7e2c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:39.218727 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053d7ac-a3da-4fc2-a9d1-6941154048b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:39.219440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d7ac-a3da-4fc2-a9d1-6941154048b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:39.219722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d7ac-a3da-4fc2-a9d1-6941154048b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:39.220000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d7ac-a3da-4fc2-a9d1-6941154048b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:39.220868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053d7ac-a3da-4fc2-a9d1-6941154048b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:39.221034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053d7ac-a3da-4fc2-a9d1-6941154048b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:39.222679 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053d7ac-a3da-4fc2-a9d1-6941154048b3 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:39.234796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1087/2166] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:32:39.241793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197b1ec-2907-43b3-964f-c8718254a1a0 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:39.251542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197b1ec-2907-43b3-964f-c8718254a1a0 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:39.257427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2544d-8567-4147-8c65-769b061568b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:39.258020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2544d-8567-4147-8c65-769b061568b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:39.258383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2544d-8567-4147-8c65-769b061568b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:39.258608 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2544d-8567-4147-8c65-769b061568b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:39.267073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2544d-8567-4147-8c65-769b061568b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:39.267073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2544d-8567-4147-8c65-769b061568b7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:39.294342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1080/2167] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:39 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:32:39.297976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053d7ac-a3da-4fc2-a9d1-6941154048b3 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:39.308536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053d7ac-a3da-4fc2-a9d1-6941154048b3 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:39.366702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a189397-ff11-48f8-b7a4-f7f1aa09039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:39.367479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a189397-ff11-48f8-b7a4-f7f1aa09039e admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:39.367698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a189397-ff11-48f8-b7a4-f7f1aa09039e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:39.367972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a189397-ff11-48f8-b7a4-f7f1aa09039e admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:39.368684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a189397-ff11-48f8-b7a4-f7f1aa09039e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:39.370799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a189397-ff11-48f8-b7a4-f7f1aa09039e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:39.390985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1088/2168] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:39 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:32:39.395212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2544d-8567-4147-8c65-769b061568b7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:39.405550 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2544d-8567-4147-8c65-769b061568b7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:39.410729 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d6a51-3cf1-45c3-988e-c433d70c2c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:39.411441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d6a51-3cf1-45c3-988e-c433d70c2c64 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:39.411721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d6a51-3cf1-45c3-988e-c433d70c2c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:39.411995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d6a51-3cf1-45c3-988e-c433d70c2c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:39.412743 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d6a51-3cf1-45c3-988e-c433d70c2c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:39.414336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d6a51-3cf1-45c3-988e-c433d70c2c64 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:39.426298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1081/2169] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:39.430532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a189397-ff11-48f8-b7a4-f7f1aa09039e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:39.441019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a189397-ff11-48f8-b7a4-f7f1aa09039e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:39.445757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c67ca9-60eb-4ffd-a0bc-fbe7c4c981ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:39.446595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c67ca9-60eb-4ffd-a0bc-fbe7c4c981ed admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:39.446809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c67ca9-60eb-4ffd-a0bc-fbe7c4c981ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:39.447189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c67ca9-60eb-4ffd-a0bc-fbe7c4c981ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:39.447993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c67ca9-60eb-4ffd-a0bc-fbe7c4c981ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:39.449659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c67ca9-60eb-4ffd-a0bc-fbe7c4c981ed admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:39.460426 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1089/2170] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:39.465185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d6a51-3cf1-45c3-988e-c433d70c2c64 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:39.478969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d6a51-3cf1-45c3-988e-c433d70c2c64 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:39.483895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680a5a5-adfc-4880-ac98-a28a8ec18412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:39.485318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a5a5-adfc-4880-ac98-a28a8ec18412 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:39.485788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a5a5-adfc-4880-ac98-a28a8ec18412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:39.486845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680a5a5-adfc-4880-ac98-a28a8ec18412 admin admin] PATH_INFO: `/v3/projects/df6fce7b5f874e3aaa2dbe6704900444/users/6b309cba58de4cd6bd613dbf09f25d09/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:39.507618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680a5a5-adfc-4880-ac98-a28a8ec18412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6fce7b5f874e3aaa2dbe6704900444, user_id=6b309cba58de4cd6bd613dbf09f25d09, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:39.510293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680a5a5-adfc-4880-ac98-a28a8ec18412 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:39.524753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1082/2171] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:39 2022] PUT /identity/v3/projects/df6fce7b5f874e3aaa2dbe6704900444/users/6b309cba58de4cd6bd613dbf09f25d09/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:39.535839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ef1b8-eeb0-4778-aac5-70ce163bf4c5 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:39.536361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ef1b8-eeb0-4778-aac5-70ce163bf4c5 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:39.536451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ef1b8-eeb0-4778-aac5-70ce163bf4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:39.565454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6b9ef1b8-eeb0-4778-aac5-70ce163bf4c5 None None] MFA Rules not processed for user `6b309cba58de4cd6bd613dbf09f25d09`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:39.566688 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6b9ef1b8-eeb0-4778-aac5-70ce163bf4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:39.629053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1090/2172] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:39.640942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680a5a5-adfc-4880-ac98-a28a8ec18412 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:39.642693 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6680a5a5-adfc-4880-ac98-a28a8ec18412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:39.703610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680a5a5-adfc-4880-ac98-a28a8ec18412 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:39.707993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e88eb-8d98-4ac3-b972-928ac62d2154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:39.708660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e88eb-8d98-4ac3-b972-928ac62d2154 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:39.708945 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e88eb-8d98-4ac3-b972-928ac62d2154 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:39.709224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e88eb-8d98-4ac3-b972-928ac62d2154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:39.718426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e88eb-8d98-4ac3-b972-928ac62d2154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:39.719901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e88eb-8d98-4ac3-b972-928ac62d2154 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:39.732611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1083/2173] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:55.135426 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ef1b8-eeb0-4778-aac5-70ce163bf4c5 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:55.210141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ef1b8-eeb0-4778-aac5-70ce163bf4c5 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:55.215564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:55.216440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:55.216720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:55.216990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] PATH_INFO: `/v3/users/6b309cba58de4cd6bd613dbf09f25d09` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:55.221431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b309cba58de4cd6bd613dbf09f25d09)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:55.223563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:55.278684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b309cba58de4cd6bd613dbf09f25d09'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.286464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b309cba58de4cd6bd613dbf09f25d09'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.287312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b309cba58de4cd6bd613dbf09f25d09'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.288255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b309cba58de4cd6bd613dbf09f25d09'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.305809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b309cba58de4cd6bd613dbf09f25d09'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.322359 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1091/2174] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:55 2022] DELETE /identity/v3/users/6b309cba58de4cd6bd613dbf09f25d09 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:55.326934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f815-52a5-4f81-92be-f0eb16f7ab85 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:55.327497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f815-52a5-4f81-92be-f0eb16f7ab85 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:55.327610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3f815-52a5-4f81-92be-f0eb16f7ab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:55.350105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-7bd3f815-52a5-4f81-92be-f0eb16f7ab85 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:55.351508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7bd3f815-52a5-4f81-92be-f0eb16f7ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:55.430487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1084/2175] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:55.440176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:55.442400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:55.508494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98226773-c8c2-4647-9a23-bef08ca528cf admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:55.514465 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9540d88-9d26-42b8-95a1-a0a69d1fc087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:55.515183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9540d88-9d26-42b8-95a1-a0a69d1fc087 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:55.515475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9540d88-9d26-42b8-95a1-a0a69d1fc087 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:55.515749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9540d88-9d26-42b8-95a1-a0a69d1fc087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:55.526098 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9540d88-9d26-42b8-95a1-a0a69d1fc087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:55.527626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9540d88-9d26-42b8-95a1-a0a69d1fc087 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:55.540158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1092/2176] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:32:55.822749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f815-52a5-4f81-92be-f0eb16f7ab85 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:55.824679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7bd3f815-52a5-4f81-92be-f0eb16f7ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:55.839305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3f815-52a5-4f81-92be-f0eb16f7ab85 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:55.845241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9540d88-9d26-42b8-95a1-a0a69d1fc087 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:55.848979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e9540d88-9d26-42b8-95a1-a0a69d1fc087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:55.849586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:55.850582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:55.850829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:55.851606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] PATH_INFO: `/v3/users/da7fdf5ac16849ba98a2918ccc75f7b7` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:55.853067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7fdf5ac16849ba98a2918ccc75f7b7)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:55.855084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:55.865527 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9540d88-9d26-42b8-95a1-a0a69d1fc087 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:55.872280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:55.873494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:55.873867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:55.874593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] PATH_INFO: `/v3/projects/df6fce7b5f874e3aaa2dbe6704900444` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:55.876163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6fce7b5f874e3aaa2dbe6704900444)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:55.878744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:55.916203 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7fdf5ac16849ba98a2918ccc75f7b7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.917093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7fdf5ac16849ba98a2918ccc75f7b7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.925660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7fdf5ac16849ba98a2918ccc75f7b7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.926476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7fdf5ac16849ba98a2918ccc75f7b7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.937165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-71f6b0a0-bac0-48e7-9876-4b805ceac428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7fdf5ac16849ba98a2918ccc75f7b7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.942743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6fce7b5f874e3aaa2dbe6704900444', 'request_id': 'req-09043e0f-f7b2-4b47-b247-2f48074a0df8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.953420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6fce7b5f874e3aaa2dbe6704900444', 'request_id': 'req-09043e0f-f7b2-4b47-b247-2f48074a0df8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.961258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6fce7b5f874e3aaa2dbe6704900444', 'request_id': 'req-09043e0f-f7b2-4b47-b247-2f48074a0df8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.976103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1085/2177] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:55 2022] DELETE /identity/v3/users/da7fdf5ac16849ba98a2918ccc75f7b7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:55.978547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] The token cache is being invalidate because project df6fce7b5f874e3aaa2dbe6704900444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:55.978868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.979914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:55.981229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9e805-2938-4253-b356-45e3c7cba0ed None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:55.983070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1093/2178] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:55 2022] DELETE /identity/v3/projects/df6fce7b5f874e3aaa2dbe6704900444 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:55.983204 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9e805-2938-4253-b356-45e3c7cba0ed None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:55.983204 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9e805-2938-4253-b356-45e3c7cba0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:56.015255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-fdc9e805-2938-4253-b356-45e3c7cba0ed None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:56.016326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-fdc9e805-2938-4253-b356-45e3c7cba0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:56.111476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1086/2179] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:56.123063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:56.125038 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:56.194804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09043e0f-f7b2-4b47-b247-2f48074a0df8 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:56.246598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e3575-2358-45ec-8c59-ffff67d43995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:56.247299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e3575-2358-45ec-8c59-ffff67d43995 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:56.247587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e3575-2358-45ec-8c59-ffff67d43995 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:56.247868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e3575-2358-45ec-8c59-ffff67d43995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:56.258383 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e3575-2358-45ec-8c59-ffff67d43995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:56.260706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e3575-2358-45ec-8c59-ffff67d43995 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:56.275138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1094/2180] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:56.560444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9e805-2938-4253-b356-45e3c7cba0ed None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:56.562770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-fdc9e805-2938-4253-b356-45e3c7cba0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:56.582712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9e805-2938-4253-b356-45e3c7cba0ed None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:56.588626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:56.589839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:56.590241 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:56.590663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] PATH_INFO: `/v3/projects/f4845d879ae844b18a7460079f248591` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:56.592085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4845d879ae844b18a7460079f248591)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:56.594128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:56.651657 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4845d879ae844b18a7460079f248591', 'request_id': 'req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:56.663770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4845d879ae844b18a7460079f248591', 'request_id': 'req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:56.671837 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4845d879ae844b18a7460079f248591', 'request_id': 'req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:56.687643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] The token cache is being invalidate because project f4845d879ae844b18a7460079f248591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:56.687934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:56.688612 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:56.691389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1087/2181] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:56 2022] DELETE /identity/v3/projects/f4845d879ae844b18a7460079f248591 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:56.694969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e3575-2358-45ec-8c59-ffff67d43995 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:56.705656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e3575-2358-45ec-8c59-ffff67d43995 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:56.787072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:56.787967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:56.788248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:56.788528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] PATH_INFO: `/v3/users/a1ebba528f46406e9be91f00cdf6d59b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:56.789761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ebba528f46406e9be91f00cdf6d59b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:56.791792 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:56.847949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ebba528f46406e9be91f00cdf6d59b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:56.855102 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ebba528f46406e9be91f00cdf6d59b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:56.855832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ebba528f46406e9be91f00cdf6d59b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:56.856609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ebba528f46406e9be91f00cdf6d59b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:56.870614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ebba528f46406e9be91f00cdf6d59b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:56.889979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1095/2182] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:56 2022] DELETE /identity/v3/users/a1ebba528f46406e9be91f00cdf6d59b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:57.196551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:57.198144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:57.212730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e65e3-a314-4a6c-bd7d-e3620bb514ab admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:57.226646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:57.228260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:57.288892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:57.289761 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:57.290039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:57.290312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] PATH_INFO: `/v3/projects/69e503b2f92741e080e1f88a04fd746d` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:57.291615 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e503b2f92741e080e1f88a04fd746d)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:57.293546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:57.305979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd49b0-aeac-4a4d-92e8-cdb2e00008ba admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:57.311126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:57.312014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:57.312293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:57.312563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] PATH_INFO: `/v3/users/5b1d0db1a20044028b5bb1ded52615d1` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:57.313804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1d0db1a20044028b5bb1ded52615d1)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:57.315824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:57.357513 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e503b2f92741e080e1f88a04fd746d', 'request_id': 'req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.365374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e503b2f92741e080e1f88a04fd746d', 'request_id': 'req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.372630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e503b2f92741e080e1f88a04fd746d', 'request_id': 'req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.373006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1d0db1a20044028b5bb1ded52615d1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.385223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1d0db1a20044028b5bb1ded52615d1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.386281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1d0db1a20044028b5bb1ded52615d1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.387242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1d0db1a20044028b5bb1ded52615d1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.396994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] The token cache is being invalidate because project 69e503b2f92741e080e1f88a04fd746d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:57.397291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.398274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.400187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1088/2183] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:57 2022] DELETE /identity/v3/projects/69e503b2f92741e080e1f88a04fd746d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:57.400982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ff055392-2061-418c-88fa-eadf60327775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1d0db1a20044028b5bb1ded52615d1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.404005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:57.405629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:57.417878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1096/2184] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:57 2022] DELETE /identity/v3/users/5b1d0db1a20044028b5bb1ded52615d1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:57.422391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901f4e-f97e-45e8-9d5c-ba0d12e384aa None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:57.422953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901f4e-f97e-45e8-9d5c-ba0d12e384aa None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:57.423186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8901f4e-f97e-45e8-9d5c-ba0d12e384aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:57.450156 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f8901f4e-f97e-45e8-9d5c-ba0d12e384aa None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:57.452315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f8901f4e-f97e-45e8-9d5c-ba0d12e384aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:57.485476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd7f1d-d226-4186-a3ef-da1341ac2d54 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:57.520418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1097/2185] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:57.531258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8901f4e-f97e-45e8-9d5c-ba0d12e384aa None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:57.532760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f8901f4e-f97e-45e8-9d5c-ba0d12e384aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:57.554585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:57.555511 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:57.555849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:57.556051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] PATH_INFO: `/v3/users/be7d02d37b3242f5914fb1d89298ea33` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:57.557277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7d02d37b3242f5914fb1d89298ea33)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:57.560823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:57.599666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8901f4e-f97e-45e8-9d5c-ba0d12e384aa None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:57.604472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c2060-ca44-41ad-a08e-6d3c5875a61a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:57.605134 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c2060-ca44-41ad-a08e-6d3c5875a61a service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:57.605422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c2060-ca44-41ad-a08e-6d3c5875a61a service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:57.605702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c2060-ca44-41ad-a08e-6d3c5875a61a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:57.613669 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7d02d37b3242f5914fb1d89298ea33'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.614832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7d02d37b3242f5914fb1d89298ea33'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.616521 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c2060-ca44-41ad-a08e-6d3c5875a61a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:57.618587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c2060-ca44-41ad-a08e-6d3c5875a61a service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:57.622341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7d02d37b3242f5914fb1d89298ea33'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.623601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7d02d37b3242f5914fb1d89298ea33'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.628769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1098/2186] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:32:57.632378 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7d02d37b3242f5914fb1d89298ea33'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:57.653055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1089/2187] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:57 2022] DELETE /identity/v3/users/be7d02d37b3242f5914fb1d89298ea33 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:32:57.987964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c2060-ca44-41ad-a08e-6d3c5875a61a service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:57.990572 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:58.002802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4e3c2060-ca44-41ad-a08e-6d3c5875a61a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.003018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.030181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c2060-ca44-41ad-a08e-6d3c5875a61a service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:58.109594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be814367-9e30-4e25-b667-5733bf2ab941 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:58.116229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:58.117117 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.117600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.117886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] PATH_INFO: `/v3/projects/d044e476565345729b50ac5f106f391b` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.119595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d044e476565345729b50ac5f106f391b)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:58.121529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:58.132764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:58.134232 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.134710 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.135427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] PATH_INFO: `/v3/projects/e662cf5ddd744394b9cc8df77cc6ab30` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.137448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e662cf5ddd744394b9cc8df77cc6ab30)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:58.141263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:58.178638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd044e476565345729b50ac5f106f391b', 'request_id': 'req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.187117 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd044e476565345729b50ac5f106f391b', 'request_id': 'req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.194534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd044e476565345729b50ac5f106f391b', 'request_id': 'req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.202386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e662cf5ddd744394b9cc8df77cc6ab30', 'request_id': 'req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.211256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] The token cache is being invalidate because project d044e476565345729b50ac5f106f391b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:58.211582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.212289 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.213150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e662cf5ddd744394b9cc8df77cc6ab30', 'request_id': 'req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.217363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1090/2188] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:57 2022] DELETE /identity/v3/projects/d044e476565345729b50ac5f106f391b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:58.217363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:58.217363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.219581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e662cf5ddd744394b9cc8df77cc6ab30', 'request_id': 'req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.230750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] The token cache is being invalidate because project e662cf5ddd744394b9cc8df77cc6ab30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:58.231462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.231837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6bd83e14-4dd6-4c11-a8e9-c3aeb188695e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.233587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1099/2189] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:57 2022] DELETE /identity/v3/projects/e662cf5ddd744394b9cc8df77cc6ab30 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:58.237822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4409-9ae1-45ea-b2d0-da35a34d8ceb None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.238188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4409-9ae1-45ea-b2d0-da35a34d8ceb None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.238482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4409-9ae1-45ea-b2d0-da35a34d8ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.258028 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-064a4409-9ae1-45ea-b2d0-da35a34d8ceb None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:58.259418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-064a4409-9ae1-45ea-b2d0-da35a34d8ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.282212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08e112-3f2d-4108-a81e-51d4a18cbe7f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:58.320375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1100/2190] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:58.321552 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a4409-9ae1-45ea-b2d0-da35a34d8ceb None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:58.328535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-064a4409-9ae1-45ea-b2d0-da35a34d8ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.339691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:58.340586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.340875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.341148 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a4409-9ae1-45ea-b2d0-da35a34d8ceb None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:58.341309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] PATH_INFO: `/v3/users/60773dd1b3294b0abd10ed1e22457088` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.342526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] RBAC: Authorizing `identity:delete_user(user_id=60773dd1b3294b0abd10ed1e22457088)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:58.344544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:58.346047 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:58.346631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.347288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.347288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] PATH_INFO: `/v3/users/2c792cfe829648afa96656b9f92028ed` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.348420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c792cfe829648afa96656b9f92028ed)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:58.350360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:58.402252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60773dd1b3294b0abd10ed1e22457088'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.403047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60773dd1b3294b0abd10ed1e22457088'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.411821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c792cfe829648afa96656b9f92028ed'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.412797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60773dd1b3294b0abd10ed1e22457088'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.413735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60773dd1b3294b0abd10ed1e22457088'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.418840 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c792cfe829648afa96656b9f92028ed'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.419588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c792cfe829648afa96656b9f92028ed'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.420254 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c792cfe829648afa96656b9f92028ed'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.427609 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-960673d6-999f-4bdc-bee6-8f0ae8ae445a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60773dd1b3294b0abd10ed1e22457088'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.437282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ff574c60-b869-4fd3-afed-a24cdf014806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c792cfe829648afa96656b9f92028ed'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.454376 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1091/2191] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:58 2022] DELETE /identity/v3/users/60773dd1b3294b0abd10ed1e22457088 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:58.456152 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10eae-fe6d-471a-8ad5-01ce6d6b0715 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.456589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10eae-fe6d-471a-8ad5-01ce6d6b0715 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.456801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1101/2192] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:58 2022] DELETE /identity/v3/users/2c792cfe829648afa96656b9f92028ed => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:58.459402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d189a96-6df1-449d-8ed1-ba46c5ebbf87 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.459903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d189a96-6df1-449d-8ed1-ba46c5ebbf87 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.460029 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d189a96-6df1-449d-8ed1-ba46c5ebbf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.463467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf10eae-fe6d-471a-8ad5-01ce6d6b0715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.483554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5bf10eae-fe6d-471a-8ad5-01ce6d6b0715 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:58.484816 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5bf10eae-fe6d-471a-8ad5-01ce6d6b0715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.486379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-9d189a96-6df1-449d-8ed1-ba46c5ebbf87 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:58.488167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9d189a96-6df1-449d-8ed1-ba46c5ebbf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.558604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1102/2193] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:32:58.563882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1092/2194] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:58.567178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d189a96-6df1-449d-8ed1-ba46c5ebbf87 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:58.570385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf10eae-fe6d-471a-8ad5-01ce6d6b0715 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:58.572088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5bf10eae-fe6d-471a-8ad5-01ce6d6b0715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.578629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d189a96-6df1-449d-8ed1-ba46c5ebbf87 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:58.583534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59550a-0c9b-4a34-8e99-dc66f36f014c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:58.584202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59550a-0c9b-4a34-8e99-dc66f36f014c admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.584489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59550a-0c9b-4a34-8e99-dc66f36f014c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.584905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59550a-0c9b-4a34-8e99-dc66f36f014c admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.585734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59550a-0c9b-4a34-8e99-dc66f36f014c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:58.586049 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59550a-0c9b-4a34-8e99-dc66f36f014c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:58.587748 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59550a-0c9b-4a34-8e99-dc66f36f014c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:58.603600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1103/2195] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:32:58.620189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59550a-0c9b-4a34-8e99-dc66f36f014c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:58.642031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59550a-0c9b-4a34-8e99-dc66f36f014c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:58.652653 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4454271-6c7f-4951-b669-d993c435cb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:58.653463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4454271-6c7f-4951-b669-d993c435cb65 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.653854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4454271-6c7f-4951-b669-d993c435cb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.654274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4454271-6c7f-4951-b669-d993c435cb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.655240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4454271-6c7f-4951-b669-d993c435cb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:58.655523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf10eae-fe6d-471a-8ad5-01ce6d6b0715 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:58.658414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4454271-6c7f-4951-b669-d993c435cb65 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:58.659980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4ae1d-2d3c-4184-8993-7eb6a47060fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:58.660645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4ae1d-2d3c-4184-8993-7eb6a47060fd service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.660928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4ae1d-2d3c-4184-8993-7eb6a47060fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.661203 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4ae1d-2d3c-4184-8993-7eb6a47060fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.683441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4ae1d-2d3c-4184-8993-7eb6a47060fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:58.685109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4ae1d-2d3c-4184-8993-7eb6a47060fd service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:58.701205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1104/2196] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:58 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:58.705170 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4454271-6c7f-4951-b669-d993c435cb65 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:58.709105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1093/2197] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:58.780624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4ae1d-2d3c-4184-8993-7eb6a47060fd service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:58.783069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-31c4ae1d-2d3c-4184-8993-7eb6a47060fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.789807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4454271-6c7f-4951-b669-d993c435cb65 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:58.795702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731f34e-9189-480b-ad29-83d5b029fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:58.796563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731f34e-9189-480b-ad29-83d5b029fd6f admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.796916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731f34e-9189-480b-ad29-83d5b029fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.797217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731f34e-9189-480b-ad29-83d5b029fd6f admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.798080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731f34e-9189-480b-ad29-83d5b029fd6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:58.801100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731f34e-9189-480b-ad29-83d5b029fd6f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:58.801379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4ae1d-2d3c-4184-8993-7eb6a47060fd service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:58.807843 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:58.809018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.809337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.809735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] PATH_INFO: `/v3/users/d7b49f8add0d4dce8a428a5093a3ad07` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.811799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b49f8add0d4dce8a428a5093a3ad07)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:58.816108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:58.826377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1105/2198] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:58 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:32:58.827835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731f34e-9189-480b-ad29-83d5b029fd6f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:58.829721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2731f34e-9189-480b-ad29-83d5b029fd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.848120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731f34e-9189-480b-ad29-83d5b029fd6f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:58.853941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:58.854809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:58.855197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:58.856356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] PATH_INFO: `/v3/projects/9e46628a43aa4c8eb2c2e7afa411ac6c` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:58.856953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e46628a43aa4c8eb2c2e7afa411ac6c)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:58.859277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:58.904645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b49f8add0d4dce8a428a5093a3ad07'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.906030 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b49f8add0d4dce8a428a5093a3ad07'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.919996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b49f8add0d4dce8a428a5093a3ad07'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.921183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b49f8add0d4dce8a428a5093a3ad07'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.942167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e46628a43aa4c8eb2c2e7afa411ac6c', 'request_id': 'req-aa91ca67-07f2-4892-bb82-fb00577a9fc6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.957240 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ce4d6387-03fc-4c87-b5c6-d88db0ec7014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b49f8add0d4dce8a428a5093a3ad07'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.963445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e46628a43aa4c8eb2c2e7afa411ac6c', 'request_id': 'req-aa91ca67-07f2-4892-bb82-fb00577a9fc6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.975261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e46628a43aa4c8eb2c2e7afa411ac6c', 'request_id': 'req-aa91ca67-07f2-4892-bb82-fb00577a9fc6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.988983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] The token cache is being invalidate because project 9e46628a43aa4c8eb2c2e7afa411ac6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:58.989308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.989996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:58.991630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1106/2199] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:58 2022] DELETE /identity/v3/projects/9e46628a43aa4c8eb2c2e7afa411ac6c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:58.992529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:58.993915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:58.999796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1094/2200] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:58 2022] DELETE /identity/v3/users/d7b49f8add0d4dce8a428a5093a3ad07 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:59.002624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a206-dbba-4965-a799-06e08b8ae267 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.003434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a206-dbba-4965-a799-06e08b8ae267 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.004201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68a206-dbba-4965-a799-06e08b8ae267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.036670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-bf68a206-dbba-4965-a799-06e08b8ae267 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:59.039200 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bf68a206-dbba-4965-a799-06e08b8ae267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.060204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91ca67-07f2-4892-bb82-fb00577a9fc6 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.128039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899580a-0f61-4743-9b08-ec293ab885f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.129344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899580a-0f61-4743-9b08-ec293ab885f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.129344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899580a-0f61-4743-9b08-ec293ab885f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.129344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899580a-0f61-4743-9b08-ec293ab885f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.130280 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899580a-0f61-4743-9b08-ec293ab885f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.132695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899580a-0f61-4743-9b08-ec293ab885f9 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.147946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1107/2201] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:59.147946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653d67a-221a-4d18-b2ea-331d09620139 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.147946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653d67a-221a-4d18-b2ea-331d09620139 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.147946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653d67a-221a-4d18-b2ea-331d09620139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.155201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1095/2202] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:59.164786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68a206-dbba-4965-a799-06e08b8ae267 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.164786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bf68a206-dbba-4965-a799-06e08b8ae267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.168252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b653d67a-221a-4d18-b2ea-331d09620139 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:59.169856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b653d67a-221a-4d18-b2ea-331d09620139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.176739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68a206-dbba-4965-a799-06e08b8ae267 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.181462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.182349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.182635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.182915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] PATH_INFO: `/v3/projects/5dc881cf5e2d41bfab208c9315714733` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.184162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc881cf5e2d41bfab208c9315714733)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.185628 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1108/2203] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:59.186563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653d67a-221a-4d18-b2ea-331d09620139 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.187995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.197154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653d67a-221a-4d18-b2ea-331d09620139 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.201915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef0c16-8cee-4430-9acd-4f5d5ffcc4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.202581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef0c16-8cee-4430-9acd-4f5d5ffcc4ad admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.202864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef0c16-8cee-4430-9acd-4f5d5ffcc4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.203171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef0c16-8cee-4430-9acd-4f5d5ffcc4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.203899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef0c16-8cee-4430-9acd-4f5d5ffcc4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.205517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef0c16-8cee-4430-9acd-4f5d5ffcc4ad admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.216195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1109/2204] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:32:59.217648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931d9df-032d-4f17-a936-3d1df31717dd None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.217941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931d9df-032d-4f17-a936-3d1df31717dd None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.218217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931d9df-032d-4f17-a936-3d1df31717dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.237675 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-2931d9df-032d-4f17-a936-3d1df31717dd None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:59.238892 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2931d9df-032d-4f17-a936-3d1df31717dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.244971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc881cf5e2d41bfab208c9315714733', 'request_id': 'req-ef4bead0-9193-4225-9f68-7f121da87b7b'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:59.254839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc881cf5e2d41bfab208c9315714733', 'request_id': 'req-ef4bead0-9193-4225-9f68-7f121da87b7b'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:59.260710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc881cf5e2d41bfab208c9315714733', 'request_id': 'req-ef4bead0-9193-4225-9f68-7f121da87b7b'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:59.274173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] The token cache is being invalidate because project 5dc881cf5e2d41bfab208c9315714733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:32:59.274454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:59.275149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:59.276858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1096/2205] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:59 2022] DELETE /identity/v3/projects/5dc881cf5e2d41bfab208c9315714733 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:59.277626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.278988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.305816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1110/2206] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:59.306657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931d9df-032d-4f17-a936-3d1df31717dd None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.308063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2931d9df-032d-4f17-a936-3d1df31717dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.319893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931d9df-032d-4f17-a936-3d1df31717dd None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.324918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0095fd-95fd-4fc5-85f4-397599cde30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.325822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0095fd-95fd-4fc5-85f4-397599cde30a admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.326099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0095fd-95fd-4fc5-85f4-397599cde30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.326375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0095fd-95fd-4fc5-85f4-397599cde30a admin admin] PATH_INFO: `/v3/projects/0ba0ea753bb0496cbf274e802f50dd0e/users/a64c3ea69151401897e4203095676543/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.342480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0095fd-95fd-4fc5-85f4-397599cde30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba0ea753bb0496cbf274e802f50dd0e, user_id=a64c3ea69151401897e4203095676543, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.344826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bead0-9193-4225-9f68-7f121da87b7b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.345317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0095fd-95fd-4fc5-85f4-397599cde30a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.349063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa7826-8842-44d7-90b5-638b460bca6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.349850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7826-8842-44d7-90b5-638b460bca6c service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.350190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7826-8842-44d7-90b5-638b460bca6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.350614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa7826-8842-44d7-90b5-638b460bca6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.352949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-69fa7826-8842-44d7-90b5-638b460bca6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.360524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1111/2207] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:59 2022] PUT /identity/v3/projects/0ba0ea753bb0496cbf274e802f50dd0e/users/a64c3ea69151401897e4203095676543/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:59.361489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0095fd-95fd-4fc5-85f4-397599cde30a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.363558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-de0095fd-95fd-4fc5-85f4-397599cde30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.365804 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa7826-8842-44d7-90b5-638b460bca6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.367285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa7826-8842-44d7-90b5-638b460bca6c service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.377773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1097/2208] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:59.378469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa7826-8842-44d7-90b5-638b460bca6c service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.389061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa7826-8842-44d7-90b5-638b460bca6c service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.436747 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0095fd-95fd-4fc5-85f4-397599cde30a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.441962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.443216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.443501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.443773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] PATH_INFO: `/v3/users/68d07188700a4d648f1380277f6591d2` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.445328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d07188700a4d648f1380277f6591d2)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.452923 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.453119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88176dc6-5c67-482e-a041-c9f099ec06a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.453119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88176dc6-5c67-482e-a041-c9f099ec06a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.453119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88176dc6-5c67-482e-a041-c9f099ec06a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.453119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88176dc6-5c67-482e-a041-c9f099ec06a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.453433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88176dc6-5c67-482e-a041-c9f099ec06a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:32:59.453504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88176dc6-5c67-482e-a041-c9f099ec06a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.455224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88176dc6-5c67-482e-a041-c9f099ec06a4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.469063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1098/2209] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:32:59.471077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2e0e-95bd-4089-bada-568dc6e92670 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.475640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2e0e-95bd-4089-bada-568dc6e92670 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.475640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2e0e-95bd-4089-bada-568dc6e92670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.494808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-f07f2e0e-95bd-4089-bada-568dc6e92670 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:59.496276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f07f2e0e-95bd-4089-bada-568dc6e92670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.505283 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1099/2210] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:32:59.506209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2e0e-95bd-4089-bada-568dc6e92670 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.514033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d07188700a4d648f1380277f6591d2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:59.516326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2e0e-95bd-4089-bada-568dc6e92670 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.523493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d07188700a4d648f1380277f6591d2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:59.524677 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d07188700a4d648f1380277f6591d2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:59.529621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d07188700a4d648f1380277f6591d2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:59.532999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac681b9-09ad-44a2-8fa3-43a6b11b001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.534049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac681b9-09ad-44a2-8fa3-43a6b11b001d admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.534877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac681b9-09ad-44a2-8fa3-43a6b11b001d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.535460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac681b9-09ad-44a2-8fa3-43a6b11b001d admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.536368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac681b9-09ad-44a2-8fa3-43a6b11b001d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.538692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac681b9-09ad-44a2-8fa3-43a6b11b001d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.539664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d07188700a4d648f1380277f6591d2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:32:59.560970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1112/2211] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:32:59 2022] DELETE /identity/v3/users/68d07188700a4d648f1380277f6591d2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:59.562035 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.563946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.575360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1100/2212] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:32:59 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:59.577610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac681b9-09ad-44a2-8fa3-43a6b11b001d admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.580544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bac681b9-09ad-44a2-8fa3-43a6b11b001d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.636175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fac0b-8520-4e74-a8f9-e2f742cae856 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.679270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac681b9-09ad-44a2-8fa3-43a6b11b001d admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.684890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8cd49-057e-48ee-a86c-6acdb249013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.685910 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8cd49-057e-48ee-a86c-6acdb249013f admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.686424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8cd49-057e-48ee-a86c-6acdb249013f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.687160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8cd49-057e-48ee-a86c-6acdb249013f admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.687715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8cd49-057e-48ee-a86c-6acdb249013f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.690385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8cd49-057e-48ee-a86c-6acdb249013f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.714839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf16f18-a558-4a85-af90-2229c5b3a131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.715744 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1101/2213] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:32:59 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:32:59.717434 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf16f18-a558-4a85-af90-2229c5b3a131 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.717726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf16f18-a558-4a85-af90-2229c5b3a131 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.718785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf16f18-a558-4a85-af90-2229c5b3a131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.719892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8cd49-057e-48ee-a86c-6acdb249013f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.721103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-daf16f18-a558-4a85-af90-2229c5b3a131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.736282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf16f18-a558-4a85-af90-2229c5b3a131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.738321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf16f18-a558-4a85-af90-2229c5b3a131 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.741194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8cd49-057e-48ee-a86c-6acdb249013f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.746733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18784e55-94f8-427a-a24d-7eacd6b3cc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.747748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784e55-94f8-427a-a24d-7eacd6b3cc66 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.748218 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784e55-94f8-427a-a24d-7eacd6b3cc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.748643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784e55-94f8-427a-a24d-7eacd6b3cc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.749549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18784e55-94f8-427a-a24d-7eacd6b3cc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.751577 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18784e55-94f8-427a-a24d-7eacd6b3cc66 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.755196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1113/2214] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:32:59.771676 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1102/2215] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:32:59.773206 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf16f18-a558-4a85-af90-2229c5b3a131 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.783793 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf16f18-a558-4a85-af90-2229c5b3a131 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.789947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec1000-afe1-477e-bae3-829df8db8416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.790627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec1000-afe1-477e-bae3-829df8db8416 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.790913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec1000-afe1-477e-bae3-829df8db8416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.791223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec1000-afe1-477e-bae3-829df8db8416 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.791972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec1000-afe1-477e-bae3-829df8db8416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.793612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec1000-afe1-477e-bae3-829df8db8416 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.809914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1114/2216] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:32:59.814256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18784e55-94f8-427a-a24d-7eacd6b3cc66 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.828356 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18784e55-94f8-427a-a24d-7eacd6b3cc66 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.833544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3720290-afb7-43fe-84e2-bac032dbcdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:32:59.834686 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3720290-afb7-43fe-84e2-bac032dbcdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.835007 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3720290-afb7-43fe-84e2-bac032dbcdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.836171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3720290-afb7-43fe-84e2-bac032dbcdc6 admin admin] PATH_INFO: `/v3/projects/111ab86b981b46c68ecd8f2c3921c9a3/users/70fc91c6ba9748199b3097c06f79877b/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.857446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3720290-afb7-43fe-84e2-bac032dbcdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111ab86b981b46c68ecd8f2c3921c9a3, user_id=70fc91c6ba9748199b3097c06f79877b, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:32:59.860230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3720290-afb7-43fe-84e2-bac032dbcdc6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:32:59.866950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec1000-afe1-477e-bae3-829df8db8416 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:32:59.869759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d6ec1000-afe1-477e-bae3-829df8db8416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:32:59.878896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1103/2217] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:32:59 2022] PUT /identity/v3/projects/111ab86b981b46c68ecd8f2c3921c9a3/users/70fc91c6ba9748199b3097c06f79877b/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:32:59.891991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12a8fe-8777-4a6e-a468-12ab337c8fea None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:32:59.892316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12a8fe-8777-4a6e-a468-12ab337c8fea None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:32:59.892906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12a8fe-8777-4a6e-a468-12ab337c8fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:32:59.911147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec1000-afe1-477e-bae3-829df8db8416 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:32:59.930431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-ea12a8fe-8777-4a6e-a468-12ab337c8fea None None] MFA Rules not processed for user `70fc91c6ba9748199b3097c06f79877b`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:32:59.932324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ea12a8fe-8777-4a6e-a468-12ab337c8fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:00.010861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.012131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.012765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.013197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] PATH_INFO: `/v3/projects/c4c9ef050ceb4ddcbe406cca55261308` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.014946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c9ef050ceb4ddcbe406cca55261308)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.017577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.051220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1104/2218] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:00.052754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12a8fe-8777-4a6e-a468-12ab337c8fea None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.058209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ea12a8fe-8777-4a6e-a468-12ab337c8fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:00.076681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12a8fe-8777-4a6e-a468-12ab337c8fea None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.092352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c9ef050ceb4ddcbe406cca55261308', 'request_id': 'req-30b7803a-9ad4-469e-8cf3-317652cc64ae'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:00.101316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c9ef050ceb4ddcbe406cca55261308', 'request_id': 'req-30b7803a-9ad4-469e-8cf3-317652cc64ae'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:00.108727 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c9ef050ceb4ddcbe406cca55261308', 'request_id': 'req-30b7803a-9ad4-469e-8cf3-317652cc64ae'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:00.124109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] The token cache is being invalidate because project c4c9ef050ceb4ddcbe406cca55261308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:00.124572 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:00.125343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:00.127889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1115/2219] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:32:59 2022] DELETE /identity/v3/projects/c4c9ef050ceb4ddcbe406cca55261308 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:33:00.132562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.134254 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:00.153421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.154614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.154896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.155243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] PATH_INFO: `/v3/projects/d9b9e479933743fa940ac08b5d8f49d1` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.156616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b9e479933743fa940ac08b5d8f49d1)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.159764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.226100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b9e479933743fa940ac08b5d8f49d1', 'request_id': 'req-d9f83790-49b4-4877-92dd-54f19e92aa11'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:00.230759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b7803a-9ad4-469e-8cf3-317652cc64ae admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.233756 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b9e479933743fa940ac08b5d8f49d1', 'request_id': 'req-d9f83790-49b4-4877-92dd-54f19e92aa11'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:00.248473 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b9e479933743fa940ac08b5d8f49d1', 'request_id': 'req-d9f83790-49b4-4877-92dd-54f19e92aa11'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:00.268912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] The token cache is being invalidate because project d9b9e479933743fa940ac08b5d8f49d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:00.269264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:00.269968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d9f83790-49b4-4877-92dd-54f19e92aa11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:00.271717 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1105/2220] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:00 2022] DELETE /identity/v3/projects/d9b9e479933743fa940ac08b5d8f49d1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:00.273131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618ac1-c429-43a9-b67e-9063f0ffd303 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.275210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618ac1-c429-43a9-b67e-9063f0ffd303 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.275514 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618ac1-c429-43a9-b67e-9063f0ffd303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.299633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-07618ac1-c429-43a9-b67e-9063f0ffd303 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:00.301137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-07618ac1-c429-43a9-b67e-9063f0ffd303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:00.334607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490654c-8a1b-40a4-8446-f9c81e5afcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.335406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490654c-8a1b-40a4-8446-f9c81e5afcec admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.335874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490654c-8a1b-40a4-8446-f9c81e5afcec admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.336038 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490654c-8a1b-40a4-8446-f9c81e5afcec admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.336918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490654c-8a1b-40a4-8446-f9c81e5afcec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.338887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490654c-8a1b-40a4-8446-f9c81e5afcec admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.377955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1116/2221] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:00 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:00.379349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052ba24-bf31-4e90-a17a-34840ce2e26b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.379638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052ba24-bf31-4e90-a17a-34840ce2e26b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.380182 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052ba24-bf31-4e90-a17a-34840ce2e26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.399983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b052ba24-bf31-4e90-a17a-34840ce2e26b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:00.401227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b052ba24-bf31-4e90-a17a-34840ce2e26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:00.402317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1106/2222] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:00.403497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618ac1-c429-43a9-b67e-9063f0ffd303 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.405552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-07618ac1-c429-43a9-b67e-9063f0ffd303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:00.422668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618ac1-c429-43a9-b67e-9063f0ffd303 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.479167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1117/2223] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:00.480661 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19829-5eaf-477a-a004-31db2ac4857f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.480959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19829-5eaf-477a-a004-31db2ac4857f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.481243 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b19829-5eaf-477a-a004-31db2ac4857f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.500234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f65a5-ac22-46fd-ae18-dd24c93c8226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.501402 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f65a5-ac22-46fd-ae18-dd24c93c8226 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.502092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f65a5-ac22-46fd-ae18-dd24c93c8226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.502647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f65a5-ac22-46fd-ae18-dd24c93c8226 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.504049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f65a5-ac22-46fd-ae18-dd24c93c8226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.506849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f65a5-ac22-46fd-ae18-dd24c93c8226 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.511059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b5b19829-5eaf-477a-a004-31db2ac4857f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:00.512127 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b5b19829-5eaf-477a-a004-31db2ac4857f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:00.526617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1118/2224] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:00.526617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898eb72-eaa7-462e-a5b2-688e2860ed34 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.526617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898eb72-eaa7-462e-a5b2-688e2860ed34 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.526617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898eb72-eaa7-462e-a5b2-688e2860ed34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.537487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1107/2225] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:00 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:00.537487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f65a5-ac22-46fd-ae18-dd24c93c8226 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.548912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f65a5-ac22-46fd-ae18-dd24c93c8226 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.552143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-3898eb72-eaa7-462e-a5b2-688e2860ed34 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:00.553455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3898eb72-eaa7-462e-a5b2-688e2860ed34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:00.554715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb986c-a44f-47c9-b23c-3c462fda63f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.555610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb986c-a44f-47c9-b23c-3c462fda63f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.555893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb986c-a44f-47c9-b23c-3c462fda63f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.556714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb986c-a44f-47c9-b23c-3c462fda63f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.557414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb986c-a44f-47c9-b23c-3c462fda63f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:33:00.557858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb986c-a44f-47c9-b23c-3c462fda63f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.562811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1119/2226] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:00.563692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb986c-a44f-47c9-b23c-3c462fda63f7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.563932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898eb72-eaa7-462e-a5b2-688e2860ed34 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.573435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898eb72-eaa7-462e-a5b2-688e2860ed34 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.583753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2d431-56a2-4490-8ea9-2ee5341e95a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.584179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1108/2227] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:33:00.584697 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2d431-56a2-4490-8ea9-2ee5341e95a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.584697 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2d431-56a2-4490-8ea9-2ee5341e95a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.585058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb986c-a44f-47c9-b23c-3c462fda63f7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.585178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2d431-56a2-4490-8ea9-2ee5341e95a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.585927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2d431-56a2-4490-8ea9-2ee5341e95a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.587829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2d431-56a2-4490-8ea9-2ee5341e95a0 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.598181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb986c-a44f-47c9-b23c-3c462fda63f7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.600926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1120/2228] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:00.602467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2d431-56a2-4490-8ea9-2ee5341e95a0 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.607069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d172ff-b165-4ad5-b0d2-baf191c1c7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.607848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d172ff-b165-4ad5-b0d2-baf191c1c7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.608201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d172ff-b165-4ad5-b0d2-baf191c1c7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.608542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d172ff-b165-4ad5-b0d2-baf191c1c7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.609542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d172ff-b165-4ad5-b0d2-baf191c1c7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:33:00.610510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d172ff-b165-4ad5-b0d2-baf191c1c7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.613226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d172ff-b165-4ad5-b0d2-baf191c1c7c7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.615110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2d431-56a2-4490-8ea9-2ee5341e95a0 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.623813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cebac8-c6e5-4c7a-997c-ae767b2a10ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.626038 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cebac8-c6e5-4c7a-997c-ae767b2a10ec admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.626546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cebac8-c6e5-4c7a-997c-ae767b2a10ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.627049 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cebac8-c6e5-4c7a-997c-ae767b2a10ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.628166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cebac8-c6e5-4c7a-997c-ae767b2a10ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.631147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cebac8-c6e5-4c7a-997c-ae767b2a10ec admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.637493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1109/2229] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:33:00.643098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d172ff-b165-4ad5-b0d2-baf191c1c7c7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.674894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1121/2230] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:00 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:00.675662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d172ff-b165-4ad5-b0d2-baf191c1c7c7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.675885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cebac8-c6e5-4c7a-997c-ae767b2a10ec admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.770530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093a03f-1c1d-47da-9f7f-2d41cb8facf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.771437 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093a03f-1c1d-47da-9f7f-2d41cb8facf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.771821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093a03f-1c1d-47da-9f7f-2d41cb8facf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.772223 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093a03f-1c1d-47da-9f7f-2d41cb8facf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.777895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093a03f-1c1d-47da-9f7f-2d41cb8facf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.777895 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093a03f-1c1d-47da-9f7f-2d41cb8facf1 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.788180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1110/2231] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:00.789371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093a03f-1c1d-47da-9f7f-2d41cb8facf1 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.795446 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cebac8-c6e5-4c7a-997c-ae767b2a10ec admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.801133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d14ed-bf39-4d97-a4c6-f0360942644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.802016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d14ed-bf39-4d97-a4c6-f0360942644c admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.802483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d14ed-bf39-4d97-a4c6-f0360942644c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.802908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d14ed-bf39-4d97-a4c6-f0360942644c admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.803094 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093a03f-1c1d-47da-9f7f-2d41cb8facf1 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.803931 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d14ed-bf39-4d97-a4c6-f0360942644c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.806545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d14ed-bf39-4d97-a4c6-f0360942644c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.808435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a516b85-ff71-4468-86ef-3756dc05d60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.809287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a516b85-ff71-4468-86ef-3756dc05d60e admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.809761 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a516b85-ff71-4468-86ef-3756dc05d60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.810269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a516b85-ff71-4468-86ef-3756dc05d60e admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.811467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a516b85-ff71-4468-86ef-3756dc05d60e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.813865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a516b85-ff71-4468-86ef-3756dc05d60e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.850277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1111/2232] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:00 2022] POST /identity/v3/users => generated 292 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:00.850277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a516b85-ff71-4468-86ef-3756dc05d60e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.854373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1122/2233] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:00 2022] POST /identity/v3/projects => generated 401 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:00.855907 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d14ed-bf39-4d97-a4c6-f0360942644c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:00.867561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a516b85-ff71-4468-86ef-3756dc05d60e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.966578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b529-9c3c-4cf6-9dee-632b2280451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.967730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b529-9c3c-4cf6-9dee-632b2280451f admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.968606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b529-9c3c-4cf6-9dee-632b2280451f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.968606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071b529-9c3c-4cf6-9dee-632b2280451f admin admin] PATH_INFO: `/v3/projects/6cc28fdeee2141bd85dd81e6d034d4bc/users/81ca32cd9b82435b897a9405f2644fb7/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.979964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d14ed-bf39-4d97-a4c6-f0360942644c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:00.988555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071b529-9c3c-4cf6-9dee-632b2280451f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cc28fdeee2141bd85dd81e6d034d4bc, user_id=81ca32cd9b82435b897a9405f2644fb7, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.991833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071b529-9c3c-4cf6-9dee-632b2280451f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:00.992449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad863d6-6945-483f-a3ae-2c5cff7d07c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:00.994378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad863d6-6945-483f-a3ae-2c5cff7d07c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:00.995108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad863d6-6945-483f-a3ae-2c5cff7d07c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:00.995964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad863d6-6945-483f-a3ae-2c5cff7d07c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:00.997450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad863d6-6945-483f-a3ae-2c5cff7d07c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:00.999718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad863d6-6945-483f-a3ae-2c5cff7d07c4 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.010841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1112/2234] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:00 2022] PUT /identity/v3/projects/6cc28fdeee2141bd85dd81e6d034d4bc/users/81ca32cd9b82435b897a9405f2644fb7/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:01.013803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1123/2235] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:01.016414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b529-9c3c-4cf6-9dee-632b2280451f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.021299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad863d6-6945-483f-a3ae-2c5cff7d07c4 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.045279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad863d6-6945-483f-a3ae-2c5cff7d07c4 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.126276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071b529-9c3c-4cf6-9dee-632b2280451f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.134885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ff961-4d3e-4458-b4a8-7fefa928533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.135976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ff961-4d3e-4458-b4a8-7fefa928533f admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.136571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ff961-4d3e-4458-b4a8-7fefa928533f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.137031 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ff961-4d3e-4458-b4a8-7fefa928533f admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.138277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ff961-4d3e-4458-b4a8-7fefa928533f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.141938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ff961-4d3e-4458-b4a8-7fefa928533f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.142520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd4b52-5354-487f-bf4f-5a38951235b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.143985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4b52-5354-487f-bf4f-5a38951235b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.144436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4b52-5354-487f-bf4f-5a38951235b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.144927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4b52-5354-487f-bf4f-5a38951235b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.145809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd4b52-5354-487f-bf4f-5a38951235b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.147665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd4b52-5354-487f-bf4f-5a38951235b0 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.161437 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1124/2236] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:01.163958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e1cb5-1619-487a-8be7-5cb01da7ec6a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.164999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e1cb5-1619-487a-8be7-5cb01da7ec6a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.165438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e1cb5-1619-487a-8be7-5cb01da7ec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.189050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1113/2237] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:01 2022] POST /identity/v3/users => generated 301 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:01.189262 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ff961-4d3e-4458-b4a8-7fefa928533f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.202318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ff961-4d3e-4458-b4a8-7fefa928533f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.207502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-550e1cb5-1619-487a-8be7-5cb01da7ec6a None None] MFA Rules not processed for user `81ca32cd9b82435b897a9405f2644fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:01.208966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-550e1cb5-1619-487a-8be7-5cb01da7ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:01.211367 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e98ae2-435b-422b-afde-6aef3d42dce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.212707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e98ae2-435b-422b-afde-6aef3d42dce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.213277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e98ae2-435b-422b-afde-6aef3d42dce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.213658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e98ae2-435b-422b-afde-6aef3d42dce3 admin admin] PATH_INFO: `/v3/projects/866a86525a964a7e84b0ae643b2461c4/users/5c8c19a6e2374b92863bc59aedf7cc86/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.237145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e98ae2-435b-422b-afde-6aef3d42dce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866a86525a964a7e84b0ae643b2461c4, user_id=5c8c19a6e2374b92863bc59aedf7cc86, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.239955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e98ae2-435b-422b-afde-6aef3d42dce3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.267141 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1114/2238] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:01 2022] PUT /identity/v3/projects/866a86525a964a7e84b0ae643b2461c4/users/5c8c19a6e2374b92863bc59aedf7cc86/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:01.270273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e98ae2-435b-422b-afde-6aef3d42dce3 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.302927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1125/2239] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:01.304005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06ba4d-a36e-4601-b71e-5f7dfd2bba1d None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.304299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06ba4d-a36e-4601-b71e-5f7dfd2bba1d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.304579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06ba4d-a36e-4601-b71e-5f7dfd2bba1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.344996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-dc06ba4d-a36e-4601-b71e-5f7dfd2bba1d None None] MFA Rules not processed for user `5c8c19a6e2374b92863bc59aedf7cc86`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:01.347612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-dc06ba4d-a36e-4601-b71e-5f7dfd2bba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:01.377296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e98ae2-435b-422b-afde-6aef3d42dce3 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.383943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ea19a-78fd-4059-b88a-3c865c6bafb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.384752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea19a-78fd-4059-b88a-3c865c6bafb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.385162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea19a-78fd-4059-b88a-3c865c6bafb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.385538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ea19a-78fd-4059-b88a-3c865c6bafb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.386384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ea19a-78fd-4059-b88a-3c865c6bafb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.388676 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ea19a-78fd-4059-b88a-3c865c6bafb1 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.402886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1115/2240] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:01.403967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ea19a-78fd-4059-b88a-3c865c6bafb1 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.416337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ea19a-78fd-4059-b88a-3c865c6bafb1 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.421330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953fb5-b285-48b8-afc1-e45c6eb18e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.422160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953fb5-b285-48b8-afc1-e45c6eb18e16 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.422570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953fb5-b285-48b8-afc1-e45c6eb18e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.422954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f953fb5-b285-48b8-afc1-e45c6eb18e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.423864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f953fb5-b285-48b8-afc1-e45c6eb18e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.426453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f953fb5-b285-48b8-afc1-e45c6eb18e16 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.452082 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1126/2241] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:01.453287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06ba4d-a36e-4601-b71e-5f7dfd2bba1d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.468405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06ba4d-a36e-4601-b71e-5f7dfd2bba1d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.473091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1116/2242] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:01 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:01.474105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953fb5-b285-48b8-afc1-e45c6eb18e16 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.549019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f953fb5-b285-48b8-afc1-e45c6eb18e16 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.556951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51027336-4e1f-42e7-a5a8-9002534acab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.557709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51027336-4e1f-42e7-a5a8-9002534acab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.557998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51027336-4e1f-42e7-a5a8-9002534acab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.558428 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51027336-4e1f-42e7-a5a8-9002534acab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.559363 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51027336-4e1f-42e7-a5a8-9002534acab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.561034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51027336-4e1f-42e7-a5a8-9002534acab9 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.564466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1655b-6c4d-4025-b0bf-4a2902cf0a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.566162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1655b-6c4d-4025-b0bf-4a2902cf0a7c admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.566461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1655b-6c4d-4025-b0bf-4a2902cf0a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.566739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1655b-6c4d-4025-b0bf-4a2902cf0a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.567504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1655b-6c4d-4025-b0bf-4a2902cf0a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.570329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1655b-6c4d-4025-b0bf-4a2902cf0a7c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.588922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1127/2243] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:01.590911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51027336-4e1f-42e7-a5a8-9002534acab9 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.615735 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51027336-4e1f-42e7-a5a8-9002534acab9 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.616767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1117/2244] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:01 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:01.616767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1655b-6c4d-4025-b0bf-4a2902cf0a7c admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.697283 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1655b-6c4d-4025-b0bf-4a2902cf0a7c admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.703057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1846b-e713-4a42-b971-3a04df44d007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.704066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1846b-e713-4a42-b971-3a04df44d007 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.704480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1846b-e713-4a42-b971-3a04df44d007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.704862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1846b-e713-4a42-b971-3a04df44d007 admin admin] PATH_INFO: `/v3/projects/351036d40aec498d810c78e16efc1a44/users/118aee6f58274c3ab9346e38c78b3bdd/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.718147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda56a89-6ced-47a8-9b41-dfed23e9a89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.718840 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda56a89-6ced-47a8-9b41-dfed23e9a89a admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.719165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda56a89-6ced-47a8-9b41-dfed23e9a89a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.719437 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda56a89-6ced-47a8-9b41-dfed23e9a89a admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.720202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda56a89-6ced-47a8-9b41-dfed23e9a89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.722360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda56a89-6ced-47a8-9b41-dfed23e9a89a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.724925 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1846b-e713-4a42-b971-3a04df44d007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351036d40aec498d810c78e16efc1a44, user_id=118aee6f58274c3ab9346e38c78b3bdd, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.728186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1846b-e713-4a42-b971-3a04df44d007 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.749017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1118/2245] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:01 2022] PUT /identity/v3/projects/351036d40aec498d810c78e16efc1a44/users/118aee6f58274c3ab9346e38c78b3bdd/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:01.749622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1128/2246] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:01 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:01.750513 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1846b-e713-4a42-b971-3a04df44d007 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.759415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda56a89-6ced-47a8-9b41-dfed23e9a89a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.771359 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda56a89-6ced-47a8-9b41-dfed23e9a89a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.843143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1f7ef-8dcb-417c-9fb0-42a2f1549ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.843143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f7ef-8dcb-417c-9fb0-42a2f1549ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.843547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f7ef-8dcb-417c-9fb0-42a2f1549ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.843899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f7ef-8dcb-417c-9fb0-42a2f1549ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.844867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1f7ef-8dcb-417c-9fb0-42a2f1549ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.847880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1f7ef-8dcb-417c-9fb0-42a2f1549ef3 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.863684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1846b-e713-4a42-b971-3a04df44d007 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.870276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1129/2247] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:01.870276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165884c-4567-49cd-a14f-a1a49e78243c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.870276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165884c-4567-49cd-a14f-a1a49e78243c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.870276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165884c-4567-49cd-a14f-a1a49e78243c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.873988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f4867-af2b-46b5-ad52-efecc046a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.874688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f4867-af2b-46b5-ad52-efecc046a522 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.874970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f4867-af2b-46b5-ad52-efecc046a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.875295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f4867-af2b-46b5-ad52-efecc046a522 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.876432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f4867-af2b-46b5-ad52-efecc046a522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.879338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f4867-af2b-46b5-ad52-efecc046a522 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:01.920843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-4165884c-4567-49cd-a14f-a1a49e78243c None None] MFA Rules not processed for user `118aee6f58274c3ab9346e38c78b3bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:01.922199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1119/2248] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:01 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:01.922863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f4867-af2b-46b5-ad52-efecc046a522 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:01.929091 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4165884c-4567-49cd-a14f-a1a49e78243c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:01.948160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f4867-af2b-46b5-ad52-efecc046a522 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:01.964464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b030-0bdf-43ba-a270-9109e6d68835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:01.965404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b030-0bdf-43ba-a270-9109e6d68835 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:01.966927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b030-0bdf-43ba-a270-9109e6d68835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:01.967254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b030-0bdf-43ba-a270-9109e6d68835 admin admin] PATH_INFO: `/v3/projects/d1dd2315415641b68f2d8e73e88588d6/users/8dc32be47a044c96a75950bcbce14597/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:01.988853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b030-0bdf-43ba-a270-9109e6d68835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1dd2315415641b68f2d8e73e88588d6, user_id=8dc32be47a044c96a75950bcbce14597, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:01.992709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043b030-0bdf-43ba-a270-9109e6d68835 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.019850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1120/2249] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:01 2022] PUT /identity/v3/projects/d1dd2315415641b68f2d8e73e88588d6/users/8dc32be47a044c96a75950bcbce14597/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:02.021148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b030-0bdf-43ba-a270-9109e6d68835 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.050630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1130/2250] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:02.051847 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165884c-4567-49cd-a14f-a1a49e78243c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.066055 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165884c-4567-49cd-a14f-a1a49e78243c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.124087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b030-0bdf-43ba-a270-9109e6d68835 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.129748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede8772-0e1a-4d34-8e0c-6bb20c22563e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.130699 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede8772-0e1a-4d34-8e0c-6bb20c22563e admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.130986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede8772-0e1a-4d34-8e0c-6bb20c22563e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.131301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede8772-0e1a-4d34-8e0c-6bb20c22563e admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.132051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede8772-0e1a-4d34-8e0c-6bb20c22563e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.133858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede8772-0e1a-4d34-8e0c-6bb20c22563e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.155284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1121/2251] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:02.158652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede8772-0e1a-4d34-8e0c-6bb20c22563e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.164968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250328e1-9f89-4c44-9498-5a7d13209ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.166305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250328e1-9f89-4c44-9498-5a7d13209ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.166871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250328e1-9f89-4c44-9498-5a7d13209ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.167466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250328e1-9f89-4c44-9498-5a7d13209ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.169164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250328e1-9f89-4c44-9498-5a7d13209ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.173398 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250328e1-9f89-4c44-9498-5a7d13209ea0 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.173520 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede8772-0e1a-4d34-8e0c-6bb20c22563e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.179357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c53b-1ca9-4aff-aa33-e68c38496e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.180143 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c53b-1ca9-4aff-aa33-e68c38496e5b admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.180503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c53b-1ca9-4aff-aa33-e68c38496e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.180860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c53b-1ca9-4aff-aa33-e68c38496e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.181640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605c53b-1ca9-4aff-aa33-e68c38496e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.183718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605c53b-1ca9-4aff-aa33-e68c38496e5b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.185241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1131/2252] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:02.186362 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250328e1-9f89-4c44-9498-5a7d13209ea0 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.202763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250328e1-9f89-4c44-9498-5a7d13209ea0 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.209251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528e1fc-adb1-4619-935f-a61ed2f2ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.210264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528e1fc-adb1-4619-935f-a61ed2f2ceca admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.210558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528e1fc-adb1-4619-935f-a61ed2f2ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.210835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528e1fc-adb1-4619-935f-a61ed2f2ceca admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.211647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528e1fc-adb1-4619-935f-a61ed2f2ceca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.214507 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528e1fc-adb1-4619-935f-a61ed2f2ceca admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.223007 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1122/2253] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:02 2022] POST /identity/v3/projects => generated 401 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:02.224214 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c53b-1ca9-4aff-aa33-e68c38496e5b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.231144 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1132/2254] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:02.231144 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528e1fc-adb1-4619-935f-a61ed2f2ceca admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.245358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528e1fc-adb1-4619-935f-a61ed2f2ceca admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.312470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c53b-1ca9-4aff-aa33-e68c38496e5b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.317754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b34a8-8860-41cd-a1c6-572ffc1fbba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.318783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b34a8-8860-41cd-a1c6-572ffc1fbba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.319100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b34a8-8860-41cd-a1c6-572ffc1fbba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.319389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b34a8-8860-41cd-a1c6-572ffc1fbba5 admin admin] PATH_INFO: `/v3/projects/d1dd2315415641b68f2d8e73e88588d6/users/8dc32be47a044c96a75950bcbce14597/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.321472 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b34a8-8860-41cd-a1c6-572ffc1fbba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1dd2315415641b68f2d8e73e88588d6, user_id=8dc32be47a044c96a75950bcbce14597, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.324209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b34a8-8860-41cd-a1c6-572ffc1fbba5 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.335358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ba54c-9b62-43c3-950a-d9c9aea25b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.335947 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1123/2255] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:02 2022] PUT /identity/v3/projects/d1dd2315415641b68f2d8e73e88588d6/users/8dc32be47a044c96a75950bcbce14597/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:02.336293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ba54c-9b62-43c3-950a-d9c9aea25b3b admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.336675 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ba54c-9b62-43c3-950a-d9c9aea25b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.336856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b34a8-8860-41cd-a1c6-572ffc1fbba5 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.337189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ba54c-9b62-43c3-950a-d9c9aea25b3b admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.337957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ba54c-9b62-43c3-950a-d9c9aea25b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.340084 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ba54c-9b62-43c3-950a-d9c9aea25b3b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.365991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1133/2256] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:02 2022] POST /identity/v3/users => generated 307 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:02.367910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ba7be-2db6-4156-a97e-c8c98522df3d None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.368305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ba7be-2db6-4156-a97e-c8c98522df3d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.368728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ba7be-2db6-4156-a97e-c8c98522df3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.415137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-185ba7be-2db6-4156-a97e-c8c98522df3d None None] MFA Rules not processed for user `8dc32be47a044c96a75950bcbce14597`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:02.416704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-185ba7be-2db6-4156-a97e-c8c98522df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:02.432011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b34a8-8860-41cd-a1c6-572ffc1fbba5 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.439003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c223345-88b0-4599-9921-cd23324a8b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.440116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223345-88b0-4599-9921-cd23324a8b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.440485 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223345-88b0-4599-9921-cd23324a8b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.440839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c223345-88b0-4599-9921-cd23324a8b71 admin admin] PATH_INFO: `/v3/projects/4ab32322836743d59bcb37a75a4c945a/users/1800868c917d4fe399cba02e884e7af0/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.469176 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c223345-88b0-4599-9921-cd23324a8b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ab32322836743d59bcb37a75a4c945a, user_id=1800868c917d4fe399cba02e884e7af0, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.473762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c223345-88b0-4599-9921-cd23324a8b71 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.495979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1124/2257] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:02 2022] PUT /identity/v3/projects/4ab32322836743d59bcb37a75a4c945a/users/1800868c917d4fe399cba02e884e7af0/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:02.498545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c223345-88b0-4599-9921-cd23324a8b71 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.558206 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1134/2258] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:02.559556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1294c0-2b92-4fa9-9b91-4f4640892766 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.560281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1294c0-2b92-4fa9-9b91-4f4640892766 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.560281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1294c0-2b92-4fa9-9b91-4f4640892766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.615480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c223345-88b0-4599-9921-cd23324a8b71 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.621320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11185f0-1f46-41ff-8eae-6c4e45204f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.622876 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11185f0-1f46-41ff-8eae-6c4e45204f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.623358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11185f0-1f46-41ff-8eae-6c4e45204f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.623833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11185f0-1f46-41ff-8eae-6c4e45204f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.624753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11185f0-1f46-41ff-8eae-6c4e45204f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.626954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11185f0-1f46-41ff-8eae-6c4e45204f91 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.644533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1125/2259] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:02.644747 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-df1294c0-2b92-4fa9-9b91-4f4640892766 None None] MFA Rules not processed for user `1800868c917d4fe399cba02e884e7af0`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:02.644747 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-df1294c0-2b92-4fa9-9b91-4f4640892766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:02.646070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11185f0-1f46-41ff-8eae-6c4e45204f91 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.648374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d11185f0-1f46-41ff-8eae-6c4e45204f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:02.724995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11185f0-1f46-41ff-8eae-6c4e45204f91 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.734091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edcf8f-d0e0-439d-8c33-fb85b586d358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.734519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edcf8f-d0e0-439d-8c33-fb85b586d358 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.734802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edcf8f-d0e0-439d-8c33-fb85b586d358 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.735101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edcf8f-d0e0-439d-8c33-fb85b586d358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.812513 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edcf8f-d0e0-439d-8c33-fb85b586d358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.814033 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edcf8f-d0e0-439d-8c33-fb85b586d358 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.828362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1126/2260] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:02.829227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edcf8f-d0e0-439d-8c33-fb85b586d358 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.838495 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1135/2261] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:02.843396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1294c0-2b92-4fa9-9b91-4f4640892766 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.847496 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edcf8f-d0e0-439d-8c33-fb85b586d358 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.861964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1294c0-2b92-4fa9-9b91-4f4640892766 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:02.862581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8859c-bab9-478a-92a9-b8b225dd5d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.863654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8859c-bab9-478a-92a9-b8b225dd5d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.863946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8859c-bab9-478a-92a9-b8b225dd5d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.864226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8859c-bab9-478a-92a9-b8b225dd5d75 admin admin] PATH_INFO: `/v3/projects/b461c09b7c0449ae9d61545f2e19b50c/users/caf329745df7466690b2b02145c644b7/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.878849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940dd98-abf4-41a7-a69e-926026e12777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:02.879576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940dd98-abf4-41a7-a69e-926026e12777 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:02.880116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940dd98-abf4-41a7-a69e-926026e12777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:02.880394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940dd98-abf4-41a7-a69e-926026e12777 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:02.881092 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940dd98-abf4-41a7-a69e-926026e12777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.888279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940dd98-abf4-41a7-a69e-926026e12777 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.905417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8859c-bab9-478a-92a9-b8b225dd5d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b461c09b7c0449ae9d61545f2e19b50c, user_id=caf329745df7466690b2b02145c644b7, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:02.908357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8859c-bab9-478a-92a9-b8b225dd5d75 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:02.932063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1127/2262] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:02 2022] PUT /identity/v3/projects/b461c09b7c0449ae9d61545f2e19b50c/users/caf329745df7466690b2b02145c644b7/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:02.936716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8859c-bab9-478a-92a9-b8b225dd5d75 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:02.941461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-40c8859c-bab9-478a-92a9-b8b225dd5d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:02.945959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1136/2263] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:02 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:33:02.946997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940dd98-abf4-41a7-a69e-926026e12777 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:03.069363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8859c-bab9-478a-92a9-b8b225dd5d75 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:03.086175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940dd98-abf4-41a7-a69e-926026e12777 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:03.101710 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363b944-119c-4af5-b9cd-b4b123cdb8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:03.103342 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363b944-119c-4af5-b9cd-b4b123cdb8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:03.103629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363b944-119c-4af5-b9cd-b4b123cdb8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:03.103910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363b944-119c-4af5-b9cd-b4b123cdb8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:03.104670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363b944-119c-4af5-b9cd-b4b123cdb8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:03.106345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363b944-119c-4af5-b9cd-b4b123cdb8ea admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:03.144328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1137/2264] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:03.145235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363b944-119c-4af5-b9cd-b4b123cdb8ea admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:03.168797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363b944-119c-4af5-b9cd-b4b123cdb8ea admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:03.183195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0017f-a1c5-484e-96db-2f695fcc2d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:03.184109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0017f-a1c5-484e-96db-2f695fcc2d1b service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:03.184677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0017f-a1c5-484e-96db-2f695fcc2d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:03.185013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0017f-a1c5-484e-96db-2f695fcc2d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:03.192656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57abcf4-c2af-4889-81eb-d5c9cac852c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:03.193354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57abcf4-c2af-4889-81eb-d5c9cac852c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:03.193640 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57abcf4-c2af-4889-81eb-d5c9cac852c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:03.193918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57abcf4-c2af-4889-81eb-d5c9cac852c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:03.194342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b9c0017f-a1c5-484e-96db-2f695fcc2d1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:03.194622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57abcf4-c2af-4889-81eb-d5c9cac852c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:03.196618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57abcf4-c2af-4889-81eb-d5c9cac852c6 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:03.240536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1138/2265] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:03 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:03.244360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57abcf4-c2af-4889-81eb-d5c9cac852c6 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:03.278070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57abcf4-c2af-4889-81eb-d5c9cac852c6 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:03.290896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210f856-cc7f-490e-b570-a168e78ffa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:03.291845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210f856-cc7f-490e-b570-a168e78ffa2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:03.292133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210f856-cc7f-490e-b570-a168e78ffa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:03.292414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210f856-cc7f-490e-b570-a168e78ffa2e admin admin] PATH_INFO: `/v3/projects/b461c09b7c0449ae9d61545f2e19b50c/users/caf329745df7466690b2b02145c644b7/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:03.298967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210f856-cc7f-490e-b570-a168e78ffa2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b461c09b7c0449ae9d61545f2e19b50c, user_id=caf329745df7466690b2b02145c644b7, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:03.305219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210f856-cc7f-490e-b570-a168e78ffa2e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:03.334733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0017f-a1c5-484e-96db-2f695fcc2d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:03.336363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0017f-a1c5-484e-96db-2f695fcc2d1b service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:03.339933 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1139/2266] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:03 2022] PUT /identity/v3/projects/b461c09b7c0449ae9d61545f2e19b50c/users/caf329745df7466690b2b02145c644b7/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:03.341498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210f856-cc7f-490e-b570-a168e78ffa2e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:03.358019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1128/2267] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:03.359207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d856f95-e363-4a5a-bc25-aed075eeb157 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:03.359501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d856f95-e363-4a5a-bc25-aed075eeb157 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:03.364420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d856f95-e363-4a5a-bc25-aed075eeb157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:03.422688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-1d856f95-e363-4a5a-bc25-aed075eeb157 None None] MFA Rules not processed for user `caf329745df7466690b2b02145c644b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:03.423629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1d856f95-e363-4a5a-bc25-aed075eeb157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:03.520101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210f856-cc7f-490e-b570-a168e78ffa2e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:03.533341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91582a06-9280-4b54-899e-410282a296f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:03.547244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91582a06-9280-4b54-899e-410282a296f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:03.549478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91582a06-9280-4b54-899e-410282a296f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:03.550615 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91582a06-9280-4b54-899e-410282a296f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:03.554470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91582a06-9280-4b54-899e-410282a296f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:03.560124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91582a06-9280-4b54-899e-410282a296f6 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:03.600561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1129/2268] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:03.622015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1140/2269] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:03.628090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d856f95-e363-4a5a-bc25-aed075eeb157 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:03.639177 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d856f95-e363-4a5a-bc25-aed075eeb157 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:03.646373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee3cec-655e-4599-abe8-21355b7c2de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:03.646373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee3cec-655e-4599-abe8-21355b7c2de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:03.646373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee3cec-655e-4599-abe8-21355b7c2de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:03.646373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee3cec-655e-4599-abe8-21355b7c2de7 admin admin] PATH_INFO: `/v3/projects/d2251a9fc82c4dc79189580e7f4238c1/users/6f647dc7160b433a9040fd3f01a50cac/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:03.669968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee3cec-655e-4599-abe8-21355b7c2de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2251a9fc82c4dc79189580e7f4238c1, user_id=6f647dc7160b433a9040fd3f01a50cac, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:03.673111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee3cec-655e-4599-abe8-21355b7c2de7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:03.695461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1130/2270] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:03 2022] PUT /identity/v3/projects/d2251a9fc82c4dc79189580e7f4238c1/users/6f647dc7160b433a9040fd3f01a50cac/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:03.700801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91582a06-9280-4b54-899e-410282a296f6 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:03.717629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91582a06-9280-4b54-899e-410282a296f6 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:03.759792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee3cec-655e-4599-abe8-21355b7c2de7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:03.918944 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee3cec-655e-4599-abe8-21355b7c2de7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:03.927183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980b2f6-88b1-4911-9ecb-965e40517280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:03.927989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b2f6-88b1-4911-9ecb-965e40517280 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:03.928287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b2f6-88b1-4911-9ecb-965e40517280 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:03.929680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980b2f6-88b1-4911-9ecb-965e40517280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:03.938407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0809c9-76c2-4cf1-959e-22484b0fb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:03.942019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0809c9-76c2-4cf1-959e-22484b0fb66a admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:03.944498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0809c9-76c2-4cf1-959e-22484b0fb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:03.950355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0809c9-76c2-4cf1-959e-22484b0fb66a admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:03.960150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0809c9-76c2-4cf1-959e-22484b0fb66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:03.977368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0809c9-76c2-4cf1-959e-22484b0fb66a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:04.013571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1141/2271] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:04.028460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0809c9-76c2-4cf1-959e-22484b0fb66a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:04.057334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0809c9-76c2-4cf1-959e-22484b0fb66a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:04.066729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd211504-b7be-486a-a81c-131f03a7eb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:04.075273 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd211504-b7be-486a-a81c-131f03a7eb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:04.075977 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980b2f6-88b1-4911-9ecb-965e40517280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:04.076241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd211504-b7be-486a-a81c-131f03a7eb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:04.076774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd211504-b7be-486a-a81c-131f03a7eb27 admin admin] PATH_INFO: `/v3/projects/d2251a9fc82c4dc79189580e7f4238c1/users/6f647dc7160b433a9040fd3f01a50cac/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:04.077570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980b2f6-88b1-4911-9ecb-965e40517280 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:04.081946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd211504-b7be-486a-a81c-131f03a7eb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2251a9fc82c4dc79189580e7f4238c1, user_id=6f647dc7160b433a9040fd3f01a50cac, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:04.086434 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd211504-b7be-486a-a81c-131f03a7eb27 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:04.100809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1131/2272] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:33:04.121547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1142/2273] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:04 2022] PUT /identity/v3/projects/d2251a9fc82c4dc79189580e7f4238c1/users/6f647dc7160b433a9040fd3f01a50cac/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:04.148964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdcd9b-69ff-4497-98c3-68b5a607abcc None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:04.149477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdcd9b-69ff-4497-98c3-68b5a607abcc None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:04.149762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdcd9b-69ff-4497-98c3-68b5a607abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:04.186976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-87bdcd9b-69ff-4497-98c3-68b5a607abcc None None] MFA Rules not processed for user `6f647dc7160b433a9040fd3f01a50cac`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:04.188500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-87bdcd9b-69ff-4497-98c3-68b5a607abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:04.224054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd211504-b7be-486a-a81c-131f03a7eb27 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:04.333219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1132/2274] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:04.358343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd211504-b7be-486a-a81c-131f03a7eb27 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:04.364829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdcd9b-69ff-4497-98c3-68b5a607abcc None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:04.368645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fb7cf-dbd3-4a64-86a3-72256c6d499e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:04.369725 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb7cf-dbd3-4a64-86a3-72256c6d499e service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:04.370579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb7cf-dbd3-4a64-86a3-72256c6d499e service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:04.371230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fb7cf-dbd3-4a64-86a3-72256c6d499e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:04.378506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdcd9b-69ff-4497-98c3-68b5a607abcc None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:04.383071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971cea-bb5f-444a-a0d5-55b716194549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:04.383914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971cea-bb5f-444a-a0d5-55b716194549 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:04.384174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971cea-bb5f-444a-a0d5-55b716194549 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:04.384457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971cea-bb5f-444a-a0d5-55b716194549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:04.456340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fb7cf-dbd3-4a64-86a3-72256c6d499e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:04.457844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fb7cf-dbd3-4a64-86a3-72256c6d499e service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:04.468513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1143/2275] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:04.472643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971cea-bb5f-444a-a0d5-55b716194549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:04.474401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971cea-bb5f-444a-a0d5-55b716194549 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:04.497009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1133/2276] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:06.054097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da3a0-9a8b-41b4-a22d-10c5a0fa2460 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:06.054617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da3a0-9a8b-41b4-a22d-10c5a0fa2460 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:06.054711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da3a0-9a8b-41b4-a22d-10c5a0fa2460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:06.084580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d96da3a0-9a8b-41b4-a22d-10c5a0fa2460 None None] MFA Rules not processed for user `a64c3ea69151401897e4203095676543`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:06.089213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d96da3a0-9a8b-41b4-a22d-10c5a0fa2460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:06.180996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1144/2277] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:06.190734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971cea-bb5f-444a-a0d5-55b716194549 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:06.190734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-56971cea-bb5f-444a-a0d5-55b716194549 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:06.259415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971cea-bb5f-444a-a0d5-55b716194549 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:06.265670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a0408-b154-4112-b98f-cced5432706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:06.266348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a0408-b154-4112-b98f-cced5432706b admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:06.266632 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a0408-b154-4112-b98f-cced5432706b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:06.266912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a0408-b154-4112-b98f-cced5432706b admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:06.267645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a0408-b154-4112-b98f-cced5432706b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:06.270114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a0408-b154-4112-b98f-cced5432706b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:06.303171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1134/2278] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:06 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:06.307239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96da3a0-9a8b-41b4-a22d-10c5a0fa2460 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:06.319519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96da3a0-9a8b-41b4-a22d-10c5a0fa2460 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:06.382008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97044006-39d1-4176-98aa-4ac2aa995365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:06.382715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97044006-39d1-4176-98aa-4ac2aa995365 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:06.383071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97044006-39d1-4176-98aa-4ac2aa995365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:06.383297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97044006-39d1-4176-98aa-4ac2aa995365 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:06.384003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97044006-39d1-4176-98aa-4ac2aa995365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:06.385969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97044006-39d1-4176-98aa-4ac2aa995365 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:06.407899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1145/2279] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:06 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:06.412583 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a0408-b154-4112-b98f-cced5432706b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:06.426590 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a0408-b154-4112-b98f-cced5432706b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:06.431362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd06370-101a-4a8f-bd1f-e580446e5414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:06.432029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd06370-101a-4a8f-bd1f-e580446e5414 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:06.432315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd06370-101a-4a8f-bd1f-e580446e5414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:06.432595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd06370-101a-4a8f-bd1f-e580446e5414 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:06.433331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd06370-101a-4a8f-bd1f-e580446e5414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:06.434939 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd06370-101a-4a8f-bd1f-e580446e5414 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:06.447086 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1135/2280] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:33:06.451425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97044006-39d1-4176-98aa-4ac2aa995365 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:06.462071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97044006-39d1-4176-98aa-4ac2aa995365 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:06.466832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397315c-50eb-45a5-969f-5c7af6ea55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:06.467766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397315c-50eb-45a5-969f-5c7af6ea55fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:06.468048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397315c-50eb-45a5-969f-5c7af6ea55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:06.468324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397315c-50eb-45a5-969f-5c7af6ea55fb admin admin] PATH_INFO: `/v3/projects/3a4c510b25264c69a2b03086eeb7d37b/users/f0b4b4e69c104c00b816b79479a54080/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:06.483778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397315c-50eb-45a5-969f-5c7af6ea55fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4c510b25264c69a2b03086eeb7d37b, user_id=f0b4b4e69c104c00b816b79479a54080, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:06.486480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397315c-50eb-45a5-969f-5c7af6ea55fb admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:06.501831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1146/2281] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:06 2022] PUT /identity/v3/projects/3a4c510b25264c69a2b03086eeb7d37b/users/f0b4b4e69c104c00b816b79479a54080/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:06.506676 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd06370-101a-4a8f-bd1f-e580446e5414 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:06.517224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd06370-101a-4a8f-bd1f-e580446e5414 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:06.594173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca71b78-95d1-48be-9543-40b1d143a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:06.594409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca71b78-95d1-48be-9543-40b1d143a2eb admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:06.594679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca71b78-95d1-48be-9543-40b1d143a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:06.594957 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca71b78-95d1-48be-9543-40b1d143a2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:06.595883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca71b78-95d1-48be-9543-40b1d143a2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:06.597576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca71b78-95d1-48be-9543-40b1d143a2eb admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:06.613309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1136/2282] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:33:06.617473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397315c-50eb-45a5-969f-5c7af6ea55fb admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:06.634709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397315c-50eb-45a5-969f-5c7af6ea55fb admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:06.644996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c724b4-5e25-4b49-9773-7cf1af5f5912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:06.645981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c724b4-5e25-4b49-9773-7cf1af5f5912 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:06.646314 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c724b4-5e25-4b49-9773-7cf1af5f5912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:06.646587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c724b4-5e25-4b49-9773-7cf1af5f5912 admin admin] PATH_INFO: `/v3/projects/3a4c510b25264c69a2b03086eeb7d37b/users/f0b4b4e69c104c00b816b79479a54080/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:06.648783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c724b4-5e25-4b49-9773-7cf1af5f5912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a4c510b25264c69a2b03086eeb7d37b, user_id=f0b4b4e69c104c00b816b79479a54080, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:06.652664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c724b4-5e25-4b49-9773-7cf1af5f5912 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:06.673174 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1147/2283] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:06 2022] PUT /identity/v3/projects/3a4c510b25264c69a2b03086eeb7d37b/users/f0b4b4e69c104c00b816b79479a54080/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:07.679547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca71b78-95d1-48be-9543-40b1d143a2eb admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:07.819566 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca71b78-95d1-48be-9543-40b1d143a2eb admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:07.918952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e0cec-2add-467d-9e70-a26c731b9b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:07.919995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e0cec-2add-467d-9e70-a26c731b9b6e service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:07.921468 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e0cec-2add-467d-9e70-a26c731b9b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:07.921890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e0cec-2add-467d-9e70-a26c731b9b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:08.037185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c724b4-5e25-4b49-9773-7cf1af5f5912 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:08.048506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e0cec-2add-467d-9e70-a26c731b9b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:08.050130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e0cec-2add-467d-9e70-a26c731b9b6e service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:08.062423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1137/2284] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:08.120225 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c724b4-5e25-4b49-9773-7cf1af5f5912 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:08.135797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:08.137399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:08.138733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:08.139308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] PATH_INFO: `/v3/users/70fc91c6ba9748199b3097c06f79877b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:08.141815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fc91c6ba9748199b3097c06f79877b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:08.146863 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:08.237010 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fc91c6ba9748199b3097c06f79877b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:08.249541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fc91c6ba9748199b3097c06f79877b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:08.250293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fc91c6ba9748199b3097c06f79877b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:08.251672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fc91c6ba9748199b3097c06f79877b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:08.270387 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fc91c6ba9748199b3097c06f79877b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:08.289977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1148/2285] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:33:08 2022] DELETE /identity/v3/users/70fc91c6ba9748199b3097c06f79877b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:33:08.295475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b845b3-2a2e-45b4-85bc-4b8b714453e0 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:08.296044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b845b3-2a2e-45b4-85bc-4b8b714453e0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:08.296474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b845b3-2a2e-45b4-85bc-4b8b714453e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:08.323270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-95b845b3-2a2e-45b4-85bc-4b8b714453e0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:08.324973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-95b845b3-2a2e-45b4-85bc-4b8b714453e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:08.408124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1138/2286] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:33:08.421738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:08.423799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:08.503184 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf51e-3b3e-4fd4-880a-8715f0c76041 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:08.508929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52fc93-93c7-47df-938e-9e6fe296d5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:08.510012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52fc93-93c7-47df-938e-9e6fe296d5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:08.510557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52fc93-93c7-47df-938e-9e6fe296d5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:08.512316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52fc93-93c7-47df-938e-9e6fe296d5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:08.525642 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52fc93-93c7-47df-938e-9e6fe296d5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:08.527569 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52fc93-93c7-47df-938e-9e6fe296d5c8 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:08.554528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1149/2287] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:09.026571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b845b3-2a2e-45b4-85bc-4b8b714453e0 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:09.028419 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-95b845b3-2a2e-45b4-85bc-4b8b714453e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:09.182724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b845b3-2a2e-45b4-85bc-4b8b714453e0 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:09.193145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ec0ed-92d7-4d43-94ae-e1e621b24515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:09.193484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ec0ed-92d7-4d43-94ae-e1e621b24515 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:09.194512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ec0ed-92d7-4d43-94ae-e1e621b24515 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:09.194872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ec0ed-92d7-4d43-94ae-e1e621b24515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:09.197090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-723ec0ed-92d7-4d43-94ae-e1e621b24515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:09.331270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ec0ed-92d7-4d43-94ae-e1e621b24515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:09.333229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ec0ed-92d7-4d43-94ae-e1e621b24515 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:09.347549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1139/2288] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:09.448674 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52fc93-93c7-47df-938e-9e6fe296d5c8 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:09.452123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5a52fc93-93c7-47df-938e-9e6fe296d5c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:09.493363 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52fc93-93c7-47df-938e-9e6fe296d5c8 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:09.502763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:09.505044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:09.505968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:09.506657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] PATH_INFO: `/v3/projects/111ab86b981b46c68ecd8f2c3921c9a3` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:09.508842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=111ab86b981b46c68ecd8f2c3921c9a3)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:09.512457 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:09.587305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111ab86b981b46c68ecd8f2c3921c9a3', 'request_id': 'req-f0901e3c-2834-48a2-b2dc-18df50177c75'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:09.597854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111ab86b981b46c68ecd8f2c3921c9a3', 'request_id': 'req-f0901e3c-2834-48a2-b2dc-18df50177c75'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:09.608104 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111ab86b981b46c68ecd8f2c3921c9a3', 'request_id': 'req-f0901e3c-2834-48a2-b2dc-18df50177c75'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:09.621669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] The token cache is being invalidate because project 111ab86b981b46c68ecd8f2c3921c9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:09.622149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:09.623071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:09.625846 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1150/2289] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:09 2022] DELETE /identity/v3/projects/111ab86b981b46c68ecd8f2c3921c9a3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:09.633047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ec0ed-92d7-4d43-94ae-e1e621b24515 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:09.658986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ec0ed-92d7-4d43-94ae-e1e621b24515 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:09.845314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:09.846931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:09.847781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:09.847781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] PATH_INFO: `/v3/users/81ca32cd9b82435b897a9405f2644fb7` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:09.860747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ca32cd9b82435b897a9405f2644fb7)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:09.865781 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:09.969202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ca32cd9b82435b897a9405f2644fb7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:09.970408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ca32cd9b82435b897a9405f2644fb7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:09.980394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ca32cd9b82435b897a9405f2644fb7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:09.981260 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ca32cd9b82435b897a9405f2644fb7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:09.995767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ca32cd9b82435b897a9405f2644fb7'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:10.037720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1140/2290] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:33:09 2022] DELETE /identity/v3/users/81ca32cd9b82435b897a9405f2644fb7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:10.555930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:10.558995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:10.584128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0901e3c-2834-48a2-b2dc-18df50177c75 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:10.659962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:10.661951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:10.796590 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:10.797547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:10.797768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:10.798042 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] PATH_INFO: `/v3/users/118aee6f58274c3ab9346e38c78b3bdd` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:10.800914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=118aee6f58274c3ab9346e38c78b3bdd)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:10.824423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:10.956916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284656b9-125e-4773-851e-3364b3599044 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:10.972699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118aee6f58274c3ab9346e38c78b3bdd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:10.977299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:10.984931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:10.985227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:10.985588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] PATH_INFO: `/v3/projects/6cc28fdeee2141bd85dd81e6d034d4bc` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:10.996023 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cc28fdeee2141bd85dd81e6d034d4bc)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:11.012322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:11.014509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118aee6f58274c3ab9346e38c78b3bdd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.015306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118aee6f58274c3ab9346e38c78b3bdd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.019072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118aee6f58274c3ab9346e38c78b3bdd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.095481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-db5fb0af-3835-47b7-a282-2eaab0312a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118aee6f58274c3ab9346e38c78b3bdd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.130546 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1151/2291] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:33:10 2022] DELETE /identity/v3/users/118aee6f58274c3ab9346e38c78b3bdd => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:11.135823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d11200-a120-4675-bdaa-c88fbb78e25a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:11.159689 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d11200-a120-4675-bdaa-c88fbb78e25a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:11.159978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d11200-a120-4675-bdaa-c88fbb78e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:11.215138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f5d11200-a120-4675-bdaa-c88fbb78e25a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:11.216573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f5d11200-a120-4675-bdaa-c88fbb78e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:11.218395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cc28fdeee2141bd85dd81e6d034d4bc', 'request_id': 'req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.248696 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cc28fdeee2141bd85dd81e6d034d4bc', 'request_id': 'req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.267730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cc28fdeee2141bd85dd81e6d034d4bc', 'request_id': 'req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.296407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] The token cache is being invalidate because project 6cc28fdeee2141bd85dd81e6d034d4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:11.297797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.300806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.305808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1141/2292] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:10 2022] DELETE /identity/v3/projects/6cc28fdeee2141bd85dd81e6d034d4bc => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:11.312165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:11.315896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:11.401966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1152/2293] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:11.414442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d11200-a120-4675-bdaa-c88fbb78e25a None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:11.416497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f5d11200-a120-4675-bdaa-c88fbb78e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:11.480113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaff1e-a4b5-4b4d-b66e-a99380b31c54 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:11.488876 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:11.490619 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:11.491575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:11.492168 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] PATH_INFO: `/v3/users/8dc32be47a044c96a75950bcbce14597` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:11.495311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc32be47a044c96a75950bcbce14597)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:11.497603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:11.530515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d11200-a120-4675-bdaa-c88fbb78e25a None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:11.540252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6dde2-abc6-4bbc-8d79-c71314c21124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:11.541080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6dde2-abc6-4bbc-8d79-c71314c21124 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:11.541468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6dde2-abc6-4bbc-8d79-c71314c21124 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:11.541849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6dde2-abc6-4bbc-8d79-c71314c21124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:11.563729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6dde2-abc6-4bbc-8d79-c71314c21124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:11.566158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6dde2-abc6-4bbc-8d79-c71314c21124 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:11.590631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc32be47a044c96a75950bcbce14597'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.590857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1153/2294] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:33:11.592923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc32be47a044c96a75950bcbce14597'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.611259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc32be47a044c96a75950bcbce14597'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.613744 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc32be47a044c96a75950bcbce14597'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.641398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc32be47a044c96a75950bcbce14597'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:11.695738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1142/2295] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:33:11 2022] DELETE /identity/v3/users/8dc32be47a044c96a75950bcbce14597 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:33:12.391927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6dde2-abc6-4bbc-8d79-c71314c21124 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:12.394250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a6f6dde2-abc6-4bbc-8d79-c71314c21124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:12.437486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6dde2-abc6-4bbc-8d79-c71314c21124 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:12.586763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:12.587606 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:12.589981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:12.591383 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:12.591728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:12.592622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] PATH_INFO: `/v3/projects/351036d40aec498d810c78e16efc1a44` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:12.595364 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351036d40aec498d810c78e16efc1a44)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:12.597406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:12.614071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e603f-229d-4618-8596-9f7ab58a291c admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:12.630708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:12.630708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:12.630708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:12.630708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] PATH_INFO: `/v3/projects/d1dd2315415641b68f2d8e73e88588d6` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:12.638506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1dd2315415641b68f2d8e73e88588d6)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:12.647914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:12.697058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351036d40aec498d810c78e16efc1a44', 'request_id': 'req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:12.708235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351036d40aec498d810c78e16efc1a44', 'request_id': 'req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:12.718748 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351036d40aec498d810c78e16efc1a44', 'request_id': 'req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:12.751585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] The token cache is being invalidate because project 351036d40aec498d810c78e16efc1a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:12.751585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:12.760444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:12.763860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1154/2296] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:12 2022] DELETE /identity/v3/projects/351036d40aec498d810c78e16efc1a44 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:12.767593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:12.770375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:12.803459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1dd2315415641b68f2d8e73e88588d6', 'request_id': 'req-70ce1c5b-8d6e-4134-947b-989d07562a2f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:12.818736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1dd2315415641b68f2d8e73e88588d6', 'request_id': 'req-70ce1c5b-8d6e-4134-947b-989d07562a2f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:12.849144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1dd2315415641b68f2d8e73e88588d6', 'request_id': 'req-70ce1c5b-8d6e-4134-947b-989d07562a2f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:12.893293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] The token cache is being invalidate because project d1dd2315415641b68f2d8e73e88588d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:12.893629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:12.897554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-70ce1c5b-8d6e-4134-947b-989d07562a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:12.901777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1143/2297] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:12 2022] DELETE /identity/v3/projects/d1dd2315415641b68f2d8e73e88588d6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:33:12.910263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce26dc4-d23f-49e2-8eab-8dfdf788cae3 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:12.918825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91309-bb7e-469f-bded-8445a7008456 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:12.921369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91309-bb7e-469f-bded-8445a7008456 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:12.921897 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a91309-bb7e-469f-bded-8445a7008456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:12.989427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-16a91309-bb7e-469f-bded-8445a7008456 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:12.990912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-16a91309-bb7e-469f-bded-8445a7008456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:13.047141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:13.048264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:13.048550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:13.048826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] PATH_INFO: `/v3/users/caf329745df7466690b2b02145c644b7` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:13.051603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caf329745df7466690b2b02145c644b7)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:13.053621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:13.110677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1144/2298] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:13.124607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a32ed-af77-4d77-987f-b5aa0d83839a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:13.124901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a32ed-af77-4d77-987f-b5aa0d83839a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:13.128018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80a32ed-af77-4d77-987f-b5aa0d83839a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:13.144677 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caf329745df7466690b2b02145c644b7'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:13.168070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b80a32ed-af77-4d77-987f-b5aa0d83839a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:13.170285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caf329745df7466690b2b02145c644b7'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:13.171129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caf329745df7466690b2b02145c644b7'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:13.171977 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caf329745df7466690b2b02145c644b7'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:13.175639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b80a32ed-af77-4d77-987f-b5aa0d83839a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:13.193907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1145/2299] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:13.193907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a32ed-af77-4d77-987f-b5aa0d83839a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:13.205146 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caf329745df7466690b2b02145c644b7'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:13.207303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80a32ed-af77-4d77-987f-b5aa0d83839a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:13.217659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4a7d4-e4dc-4bb4-9142-1fc7212daef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:13.219109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4a7d4-e4dc-4bb4-9142-1fc7212daef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:13.220708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4a7d4-e4dc-4bb4-9142-1fc7212daef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:13.221744 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4a7d4-e4dc-4bb4-9142-1fc7212daef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:13.222772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4a7d4-e4dc-4bb4-9142-1fc7212daef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:33:13.223134 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4a7d4-e4dc-4bb4-9142-1fc7212daef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:13.227670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4a7d4-e4dc-4bb4-9142-1fc7212daef6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:13.232036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1155/2300] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:33:12 2022] DELETE /identity/v3/users/caf329745df7466690b2b02145c644b7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:13.278421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1146/2301] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:33:13.286799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:13.470953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6fc4b7-641c-42f6-b5cc-ca93703b5117 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:13.484824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b01be0-ce7d-41c6-b925-2d0fbe52f43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:13.485501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b01be0-ce7d-41c6-b925-2d0fbe52f43f admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:13.485785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b01be0-ce7d-41c6-b925-2d0fbe52f43f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:13.486058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b01be0-ce7d-41c6-b925-2d0fbe52f43f admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:13.487340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b01be0-ce7d-41c6-b925-2d0fbe52f43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:13.490039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b01be0-ce7d-41c6-b925-2d0fbe52f43f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:13.555417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1156/2302] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:13 2022] POST /identity/v3/projects => generated 383 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:13.558565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4a7d4-e4dc-4bb4-9142-1fc7212daef6 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:13.577825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4a7d4-e4dc-4bb4-9142-1fc7212daef6 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:13.668247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb0ee9-bb61-473e-b493-5608dde3dd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:13.669727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb0ee9-bb61-473e-b493-5608dde3dd3c admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:13.670752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb0ee9-bb61-473e-b493-5608dde3dd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:13.671286 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb0ee9-bb61-473e-b493-5608dde3dd3c admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:13.672381 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb0ee9-bb61-473e-b493-5608dde3dd3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:13.675791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb0ee9-bb61-473e-b493-5608dde3dd3c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:13.728089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1147/2303] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:13 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:13.729208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b01be0-ce7d-41c6-b925-2d0fbe52f43f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:13.771803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b01be0-ce7d-41c6-b925-2d0fbe52f43f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:13.778855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3308e34-6857-4e35-b969-f083f3f635ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:13.779736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3308e34-6857-4e35-b969-f083f3f635ac admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:13.780265 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3308e34-6857-4e35-b969-f083f3f635ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:13.780429 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3308e34-6857-4e35-b969-f083f3f635ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:13.781261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3308e34-6857-4e35-b969-f083f3f635ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:13.783145 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3308e34-6857-4e35-b969-f083f3f635ac admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:13.788802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb0ee9-bb61-473e-b493-5608dde3dd3c admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:13.790908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ddeb0ee9-bb61-473e-b493-5608dde3dd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:13.796693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1157/2304] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:13.801764 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3308e34-6857-4e35-b969-f083f3f635ac admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:13.811850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb0ee9-bb61-473e-b493-5608dde3dd3c admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:13.824108 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:13.831907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:13.831907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:13.831907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] PATH_INFO: `/v3/projects/b461c09b7c0449ae9d61545f2e19b50c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:13.832113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b461c09b7c0449ae9d61545f2e19b50c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:13.833299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3308e34-6857-4e35-b969-f083f3f635ac admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:13.835516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:13.840034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673930b-14bf-4ac6-b401-7a93d3a4bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:13.840901 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673930b-14bf-4ac6-b401-7a93d3a4bab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:13.841259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673930b-14bf-4ac6-b401-7a93d3a4bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:13.841637 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673930b-14bf-4ac6-b401-7a93d3a4bab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:13.842608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673930b-14bf-4ac6-b401-7a93d3a4bab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:13.846524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673930b-14bf-4ac6-b401-7a93d3a4bab4 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:13.867817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1158/2305] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:13.873282 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673930b-14bf-4ac6-b401-7a93d3a4bab4 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:13.894802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673930b-14bf-4ac6-b401-7a93d3a4bab4 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:13.909305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f180b7-7b0c-4485-8087-6920c2c6f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:13.911541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f180b7-7b0c-4485-8087-6920c2c6f19c admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:13.912020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f180b7-7b0c-4485-8087-6920c2c6f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:13.912493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f180b7-7b0c-4485-8087-6920c2c6f19c admin admin] PATH_INFO: `/v3/projects/a9501c41f0664eca9177e0071bb5b1b8/users/e6fa3252d9f04964b481dd02b378d072/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:13.957466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f180b7-7b0c-4485-8087-6920c2c6f19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9501c41f0664eca9177e0071bb5b1b8, user_id=e6fa3252d9f04964b481dd02b378d072, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:13.958329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f180b7-7b0c-4485-8087-6920c2c6f19c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:13.968276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b461c09b7c0449ae9d61545f2e19b50c', 'request_id': 'req-46dce005-31e4-4d05-af75-4ccdae76d271'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:13.987798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b461c09b7c0449ae9d61545f2e19b50c', 'request_id': 'req-46dce005-31e4-4d05-af75-4ccdae76d271'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:14.009146 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1159/2306] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:13 2022] PUT /identity/v3/projects/a9501c41f0664eca9177e0071bb5b1b8/users/e6fa3252d9f04964b481dd02b378d072/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:14.010974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ade66b-60f8-4c2f-aa6a-42ad4bca3508 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.012071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ade66b-60f8-4c2f-aa6a-42ad4bca3508 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.012458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ade66b-60f8-4c2f-aa6a-42ad4bca3508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:14.015442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b461c09b7c0449ae9d61545f2e19b50c', 'request_id': 'req-46dce005-31e4-4d05-af75-4ccdae76d271'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:14.045913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] The token cache is being invalidate because project b461c09b7c0449ae9d61545f2e19b50c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:14.046436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:14.047522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-46dce005-31e4-4d05-af75-4ccdae76d271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:14.053314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1148/2307] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:13 2022] DELETE /identity/v3/projects/b461c09b7c0449ae9d61545f2e19b50c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:14.059284 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319299c-987a-47ab-9acc-fe5728eef116 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.059794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319299c-987a-47ab-9acc-fe5728eef116 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.060274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319299c-987a-47ab-9acc-fe5728eef116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:14.083976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-30ade66b-60f8-4c2f-aa6a-42ad4bca3508 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:14.085340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-30ade66b-60f8-4c2f-aa6a-42ad4bca3508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:14.086037 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5319299c-987a-47ab-9acc-fe5728eef116 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:14.087646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5319299c-987a-47ab-9acc-fe5728eef116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:14.279728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1149/2308] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:14.291899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec80bd9-9ffa-4b86-a128-5fa23af1961f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.292247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec80bd9-9ffa-4b86-a128-5fa23af1961f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.292504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1160/2309] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:14.295694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec80bd9-9ffa-4b86-a128-5fa23af1961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:14.304157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ade66b-60f8-4c2f-aa6a-42ad4bca3508 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:14.308724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-30ade66b-60f8-4c2f-aa6a-42ad4bca3508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:14.352262 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-8ec80bd9-9ffa-4b86-a128-5fa23af1961f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:14.353508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8ec80bd9-9ffa-4b86-a128-5fa23af1961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:14.373181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1150/2310] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:14.374345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec80bd9-9ffa-4b86-a128-5fa23af1961f None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:14.386194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec80bd9-9ffa-4b86-a128-5fa23af1961f None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:14.393194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a48bd-85f5-4e74-bc85-945cc7097d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:14.393813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a48bd-85f5-4e74-bc85-945cc7097d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.394184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a48bd-85f5-4e74-bc85-945cc7097d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.394705 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a48bd-85f5-4e74-bc85-945cc7097d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:14.395709 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a48bd-85f5-4e74-bc85-945cc7097d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:33:14.396163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a48bd-85f5-4e74-bc85-945cc7097d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:14.398306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a48bd-85f5-4e74-bc85-945cc7097d84 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:14.432574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1151/2311] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:33:14.433907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a48bd-85f5-4e74-bc85-945cc7097d84 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:14.446576 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ade66b-60f8-4c2f-aa6a-42ad4bca3508 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:14.449881 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a48bd-85f5-4e74-bc85-945cc7097d84 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:14.452524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c306-995d-4fab-8f52-08fe18908e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:14.454928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c306-995d-4fab-8f52-08fe18908e10 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.455274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c306-995d-4fab-8f52-08fe18908e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.455551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32c306-995d-4fab-8f52-08fe18908e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:14.462627 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26749bb6-d746-430d-8712-b74dee25c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:14.464394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26749bb6-d746-430d-8712-b74dee25c052 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.476227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26749bb6-d746-430d-8712-b74dee25c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.476227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26749bb6-d746-430d-8712-b74dee25c052 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:14.476227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26749bb6-d746-430d-8712-b74dee25c052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:14.488195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26749bb6-d746-430d-8712-b74dee25c052 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:14.489077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32c306-995d-4fab-8f52-08fe18908e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:14.491008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32c306-995d-4fab-8f52-08fe18908e10 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:14.519392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1161/2312] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:14.553066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1152/2313] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:14 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:14.557702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c306-995d-4fab-8f52-08fe18908e10 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:14.571999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32c306-995d-4fab-8f52-08fe18908e10 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:14.682512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077f80d-d4a8-42d5-bddb-7c5d3bef626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:14.683249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077f80d-d4a8-42d5-bddb-7c5d3bef626d admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.683536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077f80d-d4a8-42d5-bddb-7c5d3bef626d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.683812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077f80d-d4a8-42d5-bddb-7c5d3bef626d admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:14.684531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077f80d-d4a8-42d5-bddb-7c5d3bef626d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:14.686556 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077f80d-d4a8-42d5-bddb-7c5d3bef626d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:14.716841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1162/2314] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:14 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:14.721371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26749bb6-d746-430d-8712-b74dee25c052 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:14.735295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26749bb6-d746-430d-8712-b74dee25c052 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:14.742655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e912f-4b99-4a9b-900e-c3dbc2ef5fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:14.743344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e912f-4b99-4a9b-900e-c3dbc2ef5fce admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.744414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e912f-4b99-4a9b-900e-c3dbc2ef5fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.744720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e912f-4b99-4a9b-900e-c3dbc2ef5fce admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:14.745493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e912f-4b99-4a9b-900e-c3dbc2ef5fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:14.748028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e912f-4b99-4a9b-900e-c3dbc2ef5fce admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:14.760220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1153/2315] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:14.763894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077f80d-d4a8-42d5-bddb-7c5d3bef626d admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:14.778574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077f80d-d4a8-42d5-bddb-7c5d3bef626d admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:14.789946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2adb25-e4b1-438d-b1fd-d08ab8d47243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:14.792015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2adb25-e4b1-438d-b1fd-d08ab8d47243 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.810518 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2adb25-e4b1-438d-b1fd-d08ab8d47243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.811211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2adb25-e4b1-438d-b1fd-d08ab8d47243 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:14.812569 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2adb25-e4b1-438d-b1fd-d08ab8d47243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:14.814474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2adb25-e4b1-438d-b1fd-d08ab8d47243 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:14.849132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e912f-4b99-4a9b-900e-c3dbc2ef5fce admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:14.856478 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1163/2316] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:14.862518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e912f-4b99-4a9b-900e-c3dbc2ef5fce admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:14.877893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22c50e-24c3-439e-ba0c-cb2907688275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:14.884783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c50e-24c3-439e-ba0c-cb2907688275 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.885094 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c50e-24c3-439e-ba0c-cb2907688275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.885429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22c50e-24c3-439e-ba0c-cb2907688275 admin admin] PATH_INFO: `/v3/projects/a6da5b1025f0424697bbc39480381efc/users/e35fc7adff114d7a8f3f3e323d481e74/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:14.909013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22c50e-24c3-439e-ba0c-cb2907688275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6da5b1025f0424697bbc39480381efc, user_id=e35fc7adff114d7a8f3f3e323d481e74, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:14.926091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22c50e-24c3-439e-ba0c-cb2907688275 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:14.978057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1154/2317] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:14 2022] PUT /identity/v3/projects/a6da5b1025f0424697bbc39480381efc/users/e35fc7adff114d7a8f3f3e323d481e74/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:14.989446 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289c76-3efb-40d7-ac41-0fcdc5a57a11 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:14.989759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289c76-3efb-40d7-ac41-0fcdc5a57a11 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:14.990013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289c76-3efb-40d7-ac41-0fcdc5a57a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:15.056333 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-51289c76-3efb-40d7-ac41-0fcdc5a57a11 None None] MFA Rules not processed for user `e35fc7adff114d7a8f3f3e323d481e74`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:15.057509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-51289c76-3efb-40d7-ac41-0fcdc5a57a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:15.154055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d269d-3092-45d1-a5c4-721bebde32b9 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:15.154570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d269d-3092-45d1-a5c4-721bebde32b9 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:15.155059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d269d-3092-45d1-a5c4-721bebde32b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:15.215752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-bb5d269d-3092-45d1-a5c4-721bebde32b9 None None] MFA Rules not processed for user `f0b4b4e69c104c00b816b79479a54080`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:15.218487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bb5d269d-3092-45d1-a5c4-721bebde32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:15.224544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1164/2318] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:15.233971 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51289c76-3efb-40d7-ac41-0fcdc5a57a11 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:15.236069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-51289c76-3efb-40d7-ac41-0fcdc5a57a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:15.364238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1155/2319] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:15.364470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51289c76-3efb-40d7-ac41-0fcdc5a57a11 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:15.365626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d269d-3092-45d1-a5c4-721bebde32b9 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:15.367950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bb5d269d-3092-45d1-a5c4-721bebde32b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:15.385289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac9ab2-4eb9-467f-8a8a-f1a120779e4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10414e35df26406786eaf49c52661cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:15.385973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac9ab2-4eb9-467f-8a8a-f1a120779e4e service glance] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:15.386263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac9ab2-4eb9-467f-8a8a-f1a120779e4e service glance] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:15.390304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac9ab2-4eb9-467f-8a8a-f1a120779e4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:15.405980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac9ab2-4eb9-467f-8a8a-f1a120779e4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:15.407721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eac9ab2-4eb9-467f-8a8a-f1a120779e4e service glance] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:15.428317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1165/2320] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:33:15.432971 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac9ab2-4eb9-467f-8a8a-f1a120779e4e service glance] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:15.436507 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9eac9ab2-4eb9-467f-8a8a-f1a120779e4e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:15.570741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac9ab2-4eb9-467f-8a8a-f1a120779e4e service glance] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:15.586469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:15.589980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:15.591211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:15.591824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] PATH_INFO: `/v3/users/5c8c19a6e2374b92863bc59aedf7cc86` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:15.602899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d269d-3092-45d1-a5c4-721bebde32b9 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:15.605111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8c19a6e2374b92863bc59aedf7cc86)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:15.612860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:15.617984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bd40f-2c16-4aa5-84ff-1da3bd4ac6fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:15.619241 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd40f-2c16-4aa5-84ff-1da3bd4ac6fb service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:15.621346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd40f-2c16-4aa5-84ff-1da3bd4ac6fb service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:15.621636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd40f-2c16-4aa5-84ff-1da3bd4ac6fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:15.624745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bd1bd40f-2c16-4aa5-84ff-1da3bd4ac6fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:15.731864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8c19a6e2374b92863bc59aedf7cc86'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:15.742309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8c19a6e2374b92863bc59aedf7cc86'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:15.745390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8c19a6e2374b92863bc59aedf7cc86'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:15.746924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8c19a6e2374b92863bc59aedf7cc86'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:15.763220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bd40f-2c16-4aa5-84ff-1da3bd4ac6fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:15.765940 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bd40f-2c16-4aa5-84ff-1da3bd4ac6fb service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:15.779236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1156/2321] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:15.794927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bd40f-2c16-4aa5-84ff-1da3bd4ac6fb service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:15.797878 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bd1bd40f-2c16-4aa5-84ff-1da3bd4ac6fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:15.807373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-888c0fb7-df93-4c7b-a925-1af9e5d0eef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8c19a6e2374b92863bc59aedf7cc86'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:15.832013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bd40f-2c16-4aa5-84ff-1da3bd4ac6fb service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:15.836765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1166/2322] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:33:15 2022] DELETE /identity/v3/users/5c8c19a6e2374b92863bc59aedf7cc86 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:15.841554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100beb-3470-474b-9557-2189eeb6d90b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:15.842011 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100beb-3470-474b-9557-2189eeb6d90b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:15.842399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100beb-3470-474b-9557-2189eeb6d90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:15.847244 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:15.848457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:15.851465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:15.851988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] PATH_INFO: `/v3/users/1e59323f23bd40928544cfac604a5270` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:15.853981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e59323f23bd40928544cfac604a5270)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:15.861876 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:15.883681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d3100beb-3470-474b-9557-2189eeb6d90b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:15.884940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d3100beb-3470-474b-9557-2189eeb6d90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:15.956497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e59323f23bd40928544cfac604a5270'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:15.957344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e59323f23bd40928544cfac604a5270'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:15.972844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e59323f23bd40928544cfac604a5270'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:15.974229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e59323f23bd40928544cfac604a5270'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:15.989020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-269aeabf-2755-46c8-a795-f698a9e64e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e59323f23bd40928544cfac604a5270'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:15.999062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1167/2323] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:33:16.020176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3100beb-3470-474b-9557-2189eeb6d90b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:16.022783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d3100beb-3470-474b-9557-2189eeb6d90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:16.047019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1157/2324] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:33:15 2022] DELETE /identity/v3/users/1e59323f23bd40928544cfac604a5270 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:16.138315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0cfa8-bcd8-4c40-9fed-d5c601ac4e5d None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:16.138773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0cfa8-bcd8-4c40-9fed-d5c601ac4e5d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:16.140564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0cfa8-bcd8-4c40-9fed-d5c601ac4e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:16.143860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3100beb-3470-474b-9557-2189eeb6d90b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:16.190408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-faa0cfa8-bcd8-4c40-9fed-d5c601ac4e5d None None] MFA Rules not processed for user `e6fa3252d9f04964b481dd02b378d072`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:16.192242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-faa0cfa8-bcd8-4c40-9fed-d5c601ac4e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:16.241820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145a29-3ee5-4a29-90c0-f4d69a7a53cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:16.242511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145a29-3ee5-4a29-90c0-f4d69a7a53cd service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:16.242804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145a29-3ee5-4a29-90c0-f4d69a7a53cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:16.243117 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58145a29-3ee5-4a29-90c0-f4d69a7a53cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:16.321114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1158/2325] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:33:16.341789 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0cfa8-bcd8-4c40-9fed-d5c601ac4e5d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:16.343515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-faa0cfa8-bcd8-4c40-9fed-d5c601ac4e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:16.384137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58145a29-3ee5-4a29-90c0-f4d69a7a53cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:16.385860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58145a29-3ee5-4a29-90c0-f4d69a7a53cd service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:16.398525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1168/2326] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:33:16.460193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0cfa8-bcd8-4c40-9fed-d5c601ac4e5d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:16.466534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ad336-7de8-4fa1-b7bc-cb95feb81813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:16.467995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ad336-7de8-4fa1-b7bc-cb95feb81813 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:16.468545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ad336-7de8-4fa1-b7bc-cb95feb81813 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:16.469015 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ad336-7de8-4fa1-b7bc-cb95feb81813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:16.504202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ad336-7de8-4fa1-b7bc-cb95feb81813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:16.505950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ad336-7de8-4fa1-b7bc-cb95feb81813 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:16.516722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1159/2327] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:16.677524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145a29-3ee5-4a29-90c0-f4d69a7a53cd service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:16.683961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-58145a29-3ee5-4a29-90c0-f4d69a7a53cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:16.888267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58145a29-3ee5-4a29-90c0-f4d69a7a53cd service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:16.914950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:16.916252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:16.918455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:16.918805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] PATH_INFO: `/v3/projects/5595513cb114487cb476e609d069709b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:16.926205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5595513cb114487cb476e609d069709b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:16.934026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:17.082233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5595513cb114487cb476e609d069709b', 'request_id': 'req-879938b1-e98a-4d12-b17e-6cbde3490ec4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.110735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ad336-7de8-4fa1-b7bc-cb95feb81813 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:17.113628 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4d4ad336-7de8-4fa1-b7bc-cb95feb81813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:17.122304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5595513cb114487cb476e609d069709b', 'request_id': 'req-879938b1-e98a-4d12-b17e-6cbde3490ec4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.152820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ad336-7de8-4fa1-b7bc-cb95feb81813 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:17.159298 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5595513cb114487cb476e609d069709b', 'request_id': 'req-879938b1-e98a-4d12-b17e-6cbde3490ec4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.214094 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] The token cache is being invalidate because project 5595513cb114487cb476e609d069709b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:17.214396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.227851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-879938b1-e98a-4d12-b17e-6cbde3490ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.234302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1169/2328] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:16 2022] DELETE /identity/v3/projects/5595513cb114487cb476e609d069709b => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:17.235960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c1172-1e8d-4aa1-b166-5b9daa7232f0 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:17.236257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c1172-1e8d-4aa1-b166-5b9daa7232f0 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:17.236575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c1172-1e8d-4aa1-b166-5b9daa7232f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:17.311597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:17.313824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:17.314326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:17.314807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] PATH_INFO: `/v3/projects/866a86525a964a7e84b0ae643b2461c4` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:17.316440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866a86525a964a7e84b0ae643b2461c4)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:17.320437 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:17.336078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-235c1172-1e8d-4aa1-b166-5b9daa7232f0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:17.337937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-235c1172-1e8d-4aa1-b166-5b9daa7232f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:17.349695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1170/2329] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:17.358543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b63b8-0fff-4da6-88ef-5b6596889ef7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:17.360324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b63b8-0fff-4da6-88ef-5b6596889ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:17.360978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b63b8-0fff-4da6-88ef-5b6596889ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:17.390454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f65b63b8-0fff-4da6-88ef-5b6596889ef7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:17.393066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f65b63b8-0fff-4da6-88ef-5b6596889ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:17.441864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866a86525a964a7e84b0ae643b2461c4', 'request_id': 'req-0a08cda4-4820-41cb-9726-0fa85a1c0112'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.454862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866a86525a964a7e84b0ae643b2461c4', 'request_id': 'req-0a08cda4-4820-41cb-9726-0fa85a1c0112'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.461850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866a86525a964a7e84b0ae643b2461c4', 'request_id': 'req-0a08cda4-4820-41cb-9726-0fa85a1c0112'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.482193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] The token cache is being invalidate because project 866a86525a964a7e84b0ae643b2461c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:17.482766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.484220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.486517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1160/2330] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:17 2022] DELETE /identity/v3/projects/866a86525a964a7e84b0ae643b2461c4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:17.491013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:17.494378 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:17.523111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1171/2331] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:33:17.531158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b63b8-0fff-4da6-88ef-5b6596889ef7 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:17.539835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b63b8-0fff-4da6-88ef-5b6596889ef7 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:17.545973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42412c01-28b6-4acf-8d3a-7525f3dc9806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:17.546933 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42412c01-28b6-4acf-8d3a-7525f3dc9806 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:17.547356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42412c01-28b6-4acf-8d3a-7525f3dc9806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:17.548409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42412c01-28b6-4acf-8d3a-7525f3dc9806 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:17.548979 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42412c01-28b6-4acf-8d3a-7525f3dc9806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:33:17.549519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42412c01-28b6-4acf-8d3a-7525f3dc9806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:17.551455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42412c01-28b6-4acf-8d3a-7525f3dc9806 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:17.567939 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1172/2332] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:33:17.572403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42412c01-28b6-4acf-8d3a-7525f3dc9806 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:17.600951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42412c01-28b6-4acf-8d3a-7525f3dc9806 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:17.608982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a63a9a-cc75-49b8-a59e-508400c49e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:17.609856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a63a9a-cc75-49b8-a59e-508400c49e29 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:17.610214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a63a9a-cc75-49b8-a59e-508400c49e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:17.610657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a63a9a-cc75-49b8-a59e-508400c49e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:17.611557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a63a9a-cc75-49b8-a59e-508400c49e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:17.614966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a63a9a-cc75-49b8-a59e-508400c49e29 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:17.618739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08cda4-4820-41cb-9726-0fa85a1c0112 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:17.626084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:17.629310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:17.630962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:17.631786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] PATH_INFO: `/v3/users/1800868c917d4fe399cba02e884e7af0` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:17.634409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1800868c917d4fe399cba02e884e7af0)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:17.636954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:17.689088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1173/2333] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:17 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:17.698579 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a63a9a-cc75-49b8-a59e-508400c49e29 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:17.726465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1800868c917d4fe399cba02e884e7af0'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.728166 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1800868c917d4fe399cba02e884e7af0'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.745549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1800868c917d4fe399cba02e884e7af0'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.746976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1800868c917d4fe399cba02e884e7af0'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.763677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1800868c917d4fe399cba02e884e7af0'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:17.788526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1161/2334] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:33:17 2022] DELETE /identity/v3/users/1800868c917d4fe399cba02e884e7af0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:17.823948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a63a9a-cc75-49b8-a59e-508400c49e29 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:17.958635 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca9f0-8386-48fb-ac4d-d3de7cacd09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:17.969818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca9f0-8386-48fb-ac4d-d3de7cacd09c admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:17.970283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca9f0-8386-48fb-ac4d-d3de7cacd09c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:17.971352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca9f0-8386-48fb-ac4d-d3de7cacd09c admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:17.972271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ca9f0-8386-48fb-ac4d-d3de7cacd09c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:17.975400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ca9f0-8386-48fb-ac4d-d3de7cacd09c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:18.015414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1174/2335] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:17 2022] POST /identity/v3/users => generated 297 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:18.019865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:18.021765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:18.041916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a44e-88cc-4fb0-97f3-64fbca5e4585 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:18.067270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dabca4-81ca-400d-99cb-5edb33029c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:18.067972 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dabca4-81ca-400d-99cb-5edb33029c06 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:18.068411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dabca4-81ca-400d-99cb-5edb33029c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:18.068697 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dabca4-81ca-400d-99cb-5edb33029c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:18.069440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dabca4-81ca-400d-99cb-5edb33029c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:18.074761 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dabca4-81ca-400d-99cb-5edb33029c06 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:18.101068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1162/2336] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:18.102252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca9f0-8386-48fb-ac4d-d3de7cacd09c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:18.118787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca9f0-8386-48fb-ac4d-d3de7cacd09c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:18.130801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5693222-6c51-4df5-943d-37700ca552c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:18.131904 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5693222-6c51-4df5-943d-37700ca552c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:18.132252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5693222-6c51-4df5-943d-37700ca552c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:18.132517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5693222-6c51-4df5-943d-37700ca552c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:18.133272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5693222-6c51-4df5-943d-37700ca552c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:18.135381 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5693222-6c51-4df5-943d-37700ca552c5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:18.151472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1175/2337] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:18.152694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dabca4-81ca-400d-99cb-5edb33029c06 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:18.193044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dabca4-81ca-400d-99cb-5edb33029c06 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:18.198913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358320c-961f-409a-b4ac-2d44fd87b81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:18.199767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358320c-961f-409a-b4ac-2d44fd87b81e admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:18.200053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358320c-961f-409a-b4ac-2d44fd87b81e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:18.200329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358320c-961f-409a-b4ac-2d44fd87b81e admin admin] PATH_INFO: `/v3/projects/3c83c8fa2cd44eab84cb50b3ad06a1d3/users/2cfa47f1da4e4ae9a358e2b8ace795ac/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:18.224912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358320c-961f-409a-b4ac-2d44fd87b81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c83c8fa2cd44eab84cb50b3ad06a1d3, user_id=2cfa47f1da4e4ae9a358e2b8ace795ac, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:18.233118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358320c-961f-409a-b4ac-2d44fd87b81e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:18.268268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1163/2338] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:18 2022] PUT /identity/v3/projects/3c83c8fa2cd44eab84cb50b3ad06a1d3/users/2cfa47f1da4e4ae9a358e2b8ace795ac/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:18.274276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94401e60-9ad0-4763-aefa-29dc6d0e0c8d None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:18.274785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94401e60-9ad0-4763-aefa-29dc6d0e0c8d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:18.274900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94401e60-9ad0-4763-aefa-29dc6d0e0c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:18.321299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-94401e60-9ad0-4763-aefa-29dc6d0e0c8d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:18.322643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-94401e60-9ad0-4763-aefa-29dc6d0e0c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:18.339862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358320c-961f-409a-b4ac-2d44fd87b81e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:18.341622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4358320c-961f-409a-b4ac-2d44fd87b81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:18.439438 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1176/2339] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:18.457916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94401e60-9ad0-4763-aefa-29dc6d0e0c8d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:18.466543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-94401e60-9ad0-4763-aefa-29dc6d0e0c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:18.496481 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358320c-961f-409a-b4ac-2d44fd87b81e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:18.506830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:18.507770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:18.508057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:18.515337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] PATH_INFO: `/v3/projects/4ab32322836743d59bcb37a75a4c945a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:18.517300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ab32322836743d59bcb37a75a4c945a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:18.522146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:18.669086 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ab32322836743d59bcb37a75a4c945a', 'request_id': 'req-a99a21cc-ee22-4b45-a587-81fa8585571e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:18.674423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ab32322836743d59bcb37a75a4c945a', 'request_id': 'req-a99a21cc-ee22-4b45-a587-81fa8585571e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:18.688619 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ab32322836743d59bcb37a75a4c945a', 'request_id': 'req-a99a21cc-ee22-4b45-a587-81fa8585571e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:18.717325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] The token cache is being invalidate because project 4ab32322836743d59bcb37a75a4c945a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:18.717658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:18.720116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:18.723848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1164/2340] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:18 2022] DELETE /identity/v3/projects/4ab32322836743d59bcb37a75a4c945a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:18.732280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:18.736439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:18.741337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94401e60-9ad0-4763-aefa-29dc6d0e0c8d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:18.855101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2da33-55f7-4d85-a925-8005bb8ed181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:18.855769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2da33-55f7-4d85-a925-8005bb8ed181 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:18.856053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2da33-55f7-4d85-a925-8005bb8ed181 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:18.856326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2da33-55f7-4d85-a925-8005bb8ed181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:18.858352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-38a2da33-55f7-4d85-a925-8005bb8ed181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:18.870052 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a21cc-ee22-4b45-a587-81fa8585571e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:18.873348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2da33-55f7-4d85-a925-8005bb8ed181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:18.875248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2da33-55f7-4d85-a925-8005bb8ed181 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:18.876174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:18.877184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:18.877688 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:18.878081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] PATH_INFO: `/v3/users/6f647dc7160b433a9040fd3f01a50cac` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:18.879791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f647dc7160b433a9040fd3f01a50cac)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:18.881791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:18.887064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1177/2341] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:19.018325 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f647dc7160b433a9040fd3f01a50cac'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:19.022621 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f647dc7160b433a9040fd3f01a50cac'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:19.056154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f647dc7160b433a9040fd3f01a50cac'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:19.059943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f647dc7160b433a9040fd3f01a50cac'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:19.081403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f647dc7160b433a9040fd3f01a50cac'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:19.122393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1165/2342] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:33:18 2022] DELETE /identity/v3/users/6f647dc7160b433a9040fd3f01a50cac => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:19.375937 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31089406-d03d-498e-8568-eea5743230c7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:19.377614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31089406-d03d-498e-8568-eea5743230c7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:19.378162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31089406-d03d-498e-8568-eea5743230c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:19.447216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-31089406-d03d-498e-8568-eea5743230c7 None None] MFA Rules not processed for user `e6fa3252d9f04964b481dd02b378d072`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:19.449056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-31089406-d03d-498e-8568-eea5743230c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:19.531787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1178/2343] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:19.760241 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:19.763294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:19.904809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c821ce-88ed-468b-afdc-17e0e6b78752 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:19.922708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:19.925321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:19.925620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:19.925905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] PATH_INFO: `/v3/projects/d2251a9fc82c4dc79189580e7f4238c1` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:19.927537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2251a9fc82c4dc79189580e7f4238c1)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:19.930394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:20.069806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2251a9fc82c4dc79189580e7f4238c1', 'request_id': 'req-ad4d25bb-52e3-427d-a72d-a1849913b1b4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:20.091969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2251a9fc82c4dc79189580e7f4238c1', 'request_id': 'req-ad4d25bb-52e3-427d-a72d-a1849913b1b4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:20.100454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2251a9fc82c4dc79189580e7f4238c1', 'request_id': 'req-ad4d25bb-52e3-427d-a72d-a1849913b1b4'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:20.119455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] The token cache is being invalidate because project d2251a9fc82c4dc79189580e7f4238c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:20.119748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:20.120575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ad4d25bb-52e3-427d-a72d-a1849913b1b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:20.125557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1166/2344] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:19 2022] DELETE /identity/v3/projects/d2251a9fc82c4dc79189580e7f4238c1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:20.127230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7f28-3c9b-4e51-b64e-bdf459bdba9b None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:20.127759 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7f28-3c9b-4e51-b64e-bdf459bdba9b None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:20.128228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff7f28-3c9b-4e51-b64e-bdf459bdba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:20.150865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-2bff7f28-3c9b-4e51-b64e-bdf459bdba9b None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:20.152375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2bff7f28-3c9b-4e51-b64e-bdf459bdba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:20.238198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1179/2345] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:33:20.247658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eb2a3-7236-44ef-837d-4c6b7b903c97 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:20.248210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eb2a3-7236-44ef-837d-4c6b7b903c97 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:20.248824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eb2a3-7236-44ef-837d-4c6b7b903c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:20.276659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-409eb2a3-7236-44ef-837d-4c6b7b903c97 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:20.278945 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-409eb2a3-7236-44ef-837d-4c6b7b903c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:20.300164 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1167/2346] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:20.304545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff7f28-3c9b-4e51-b64e-bdf459bdba9b None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:20.315721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff7f28-3c9b-4e51-b64e-bdf459bdba9b None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:20.327574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f02a4d-3915-4ef4-81ac-9579347a902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:20.328529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f02a4d-3915-4ef4-81ac-9579347a902e admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:20.329194 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f02a4d-3915-4ef4-81ac-9579347a902e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:20.329819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f02a4d-3915-4ef4-81ac-9579347a902e admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:20.331840 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f02a4d-3915-4ef4-81ac-9579347a902e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:33:20.332476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f02a4d-3915-4ef4-81ac-9579347a902e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:20.334701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f02a4d-3915-4ef4-81ac-9579347a902e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:20.379130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1180/2347] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:33:20.384073 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eb2a3-7236-44ef-837d-4c6b7b903c97 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:20.395839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eb2a3-7236-44ef-837d-4c6b7b903c97 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:20.406974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4ab25-9c72-4b8b-9a65-0ce5e71cf920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:20.407935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4ab25-9c72-4b8b-9a65-0ce5e71cf920 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:20.410122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4ab25-9c72-4b8b-9a65-0ce5e71cf920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:20.410452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4ab25-9c72-4b8b-9a65-0ce5e71cf920 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:20.411360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4ab25-9c72-4b8b-9a65-0ce5e71cf920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:20.414106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4ab25-9c72-4b8b-9a65-0ce5e71cf920 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:20.450782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1168/2348] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:20 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:33:20.455596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f02a4d-3915-4ef4-81ac-9579347a902e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:20.469895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f02a4d-3915-4ef4-81ac-9579347a902e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:20.558626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec63dc-b3f4-41c1-9156-464e073084a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:20.560013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec63dc-b3f4-41c1-9156-464e073084a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:20.560631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec63dc-b3f4-41c1-9156-464e073084a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:20.560905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec63dc-b3f4-41c1-9156-464e073084a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:20.562325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec63dc-b3f4-41c1-9156-464e073084a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:20.565726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec63dc-b3f4-41c1-9156-464e073084a9 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:20.601369 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1181/2349] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:20 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:33:20.602573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4ab25-9c72-4b8b-9a65-0ce5e71cf920 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:20.618874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4ab25-9c72-4b8b-9a65-0ce5e71cf920 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:20.643052 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2320369-5cbb-4740-9f88-e30a567bee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:20.644030 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2320369-5cbb-4740-9f88-e30a567bee2d admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:20.644708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2320369-5cbb-4740-9f88-e30a567bee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:20.645154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2320369-5cbb-4740-9f88-e30a567bee2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:20.646450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2320369-5cbb-4740-9f88-e30a567bee2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:20.648644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2320369-5cbb-4740-9f88-e30a567bee2d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:20.674142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1169/2350] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:33:20.677950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec63dc-b3f4-41c1-9156-464e073084a9 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:20.691527 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec63dc-b3f4-41c1-9156-464e073084a9 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:20.717697 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1be72c-7723-41ee-94c2-7668c2d0c059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:20.718417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1be72c-7723-41ee-94c2-7668c2d0c059 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:20.718700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1be72c-7723-41ee-94c2-7668c2d0c059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:20.719133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1be72c-7723-41ee-94c2-7668c2d0c059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:20.720077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1be72c-7723-41ee-94c2-7668c2d0c059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:20.721972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1be72c-7723-41ee-94c2-7668c2d0c059 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:20.738048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2320369-5cbb-4740-9f88-e30a567bee2d admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:20.739321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1182/2351] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:20.754983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2320369-5cbb-4740-9f88-e30a567bee2d admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:20.772047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42455acf-c06a-4e92-ae49-484d6dbe92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:20.773616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42455acf-c06a-4e92-ae49-484d6dbe92c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:20.774072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42455acf-c06a-4e92-ae49-484d6dbe92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:20.774521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42455acf-c06a-4e92-ae49-484d6dbe92c6 admin admin] PATH_INFO: `/v3/projects/2089564feda44bac86715eed2cf285f1/users/34b98d85325b4ea194c06848e508ad7a/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:20.812416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42455acf-c06a-4e92-ae49-484d6dbe92c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2089564feda44bac86715eed2cf285f1, user_id=34b98d85325b4ea194c06848e508ad7a, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:20.818040 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42455acf-c06a-4e92-ae49-484d6dbe92c6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:20.860832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1170/2352] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:20 2022] PUT /identity/v3/projects/2089564feda44bac86715eed2cf285f1/users/34b98d85325b4ea194c06848e508ad7a/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:33:20.871387 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7aaf-926e-419e-b606-b754b3c54aa9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:20.871499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7aaf-926e-419e-b606-b754b3c54aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:20.871769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7aaf-926e-419e-b606-b754b3c54aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:20.933405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-74aa7aaf-926e-419e-b606-b754b3c54aa9 None None] MFA Rules not processed for user `34b98d85325b4ea194c06848e508ad7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:20.934802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-74aa7aaf-926e-419e-b606-b754b3c54aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:21.022670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1183/2353] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:21.044302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42455acf-c06a-4e92-ae49-484d6dbe92c6 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:21.046914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-42455acf-c06a-4e92-ae49-484d6dbe92c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:21.141335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42455acf-c06a-4e92-ae49-484d6dbe92c6 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:21.151565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb557ac4-037c-4e8a-945e-e431371c37ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:21.152469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb557ac4-037c-4e8a-945e-e431371c37ab service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:21.152831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb557ac4-037c-4e8a-945e-e431371c37ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:21.153215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb557ac4-037c-4e8a-945e-e431371c37ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:21.170267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb557ac4-037c-4e8a-945e-e431371c37ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:21.173010 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb557ac4-037c-4e8a-945e-e431371c37ab service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:21.196985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1171/2354] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:23.819865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968861bb-b5d7-4c06-b3ed-87ef7d8773d1 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:23.820603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968861bb-b5d7-4c06-b3ed-87ef7d8773d1 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:23.820603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968861bb-b5d7-4c06-b3ed-87ef7d8773d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:23.847153 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-968861bb-b5d7-4c06-b3ed-87ef7d8773d1 None None] MFA Rules not processed for user `34b98d85325b4ea194c06848e508ad7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:23.849264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-968861bb-b5d7-4c06-b3ed-87ef7d8773d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:23.859088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1184/2355] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:24.459711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2ea81-e5f0-42e9-968c-21bef7c1de0c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:24.460275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2ea81-e5f0-42e9-968c-21bef7c1de0c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:24.460275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2ea81-e5f0-42e9-968c-21bef7c1de0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:24.491861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-39c2ea81-e5f0-42e9-968c-21bef7c1de0c None None] MFA Rules not processed for user `2cfa47f1da4e4ae9a358e2b8ace795ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:24.493682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-39c2ea81-e5f0-42e9-968c-21bef7c1de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:24.580679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1172/2356] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:24.590889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27534-9593-4a57-ac5d-5b6692abde5f None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:24.591212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27534-9593-4a57-ac5d-5b6692abde5f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:24.591488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27534-9593-4a57-ac5d-5b6692abde5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:24.611920 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-9ff27534-9593-4a57-ac5d-5b6692abde5f None None] MFA Rules not processed for user `2cfa47f1da4e4ae9a358e2b8ace795ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:24.613188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9ff27534-9593-4a57-ac5d-5b6692abde5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:24.622017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1185/2357] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:33.580529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2ea81-e5f0-42e9-968c-21bef7c1de0c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:33.581993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-39c2ea81-e5f0-42e9-968c-21bef7c1de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:33.689274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2ea81-e5f0-42e9-968c-21bef7c1de0c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:33.697802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9284d-f673-447e-a9b5-9403cf077839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:33.700607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9284d-f673-447e-a9b5-9403cf077839 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:33.700607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9284d-f673-447e-a9b5-9403cf077839 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:33.700607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9284d-f673-447e-a9b5-9403cf077839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:33.710979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9284d-f673-447e-a9b5-9403cf077839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:33.713538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9284d-f673-447e-a9b5-9403cf077839 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:33.728310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1173/2358] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:34.609740 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8e124-e000-4c92-b716-52ee87023787 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:34.610819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8e124-e000-4c92-b716-52ee87023787 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:34.611829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8e124-e000-4c92-b716-52ee87023787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:34.635709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-9bb8e124-e000-4c92-b716-52ee87023787 None None] MFA Rules not processed for user `2cfa47f1da4e4ae9a358e2b8ace795ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:34.637116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9bb8e124-e000-4c92-b716-52ee87023787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:34.644770 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1186/2359] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:57.166131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9284d-f673-447e-a9b5-9403cf077839 service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:57.168100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d9a9284d-f673-447e-a9b5-9403cf077839 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:57.236663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9284d-f673-447e-a9b5-9403cf077839 service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:57.241510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:57.242387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:57.242669 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:57.242947 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] PATH_INFO: `/v3/users/e35fc7adff114d7a8f3f3e323d481e74` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:57.244187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35fc7adff114d7a8f3f3e323d481e74)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:57.246151 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:57.308854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35fc7adff114d7a8f3f3e323d481e74'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:57.309555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35fc7adff114d7a8f3f3e323d481e74'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:57.317310 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35fc7adff114d7a8f3f3e323d481e74'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:57.317986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35fc7adff114d7a8f3f3e323d481e74'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:57.327794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35fc7adff114d7a8f3f3e323d481e74'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:57.347872 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1174/2360] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:33:57 2022] DELETE /identity/v3/users/e35fc7adff114d7a8f3f3e323d481e74 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:57.352430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e614c0-43a1-4305-b32d-346e15518b6e None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:57.352945 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e614c0-43a1-4305-b32d-346e15518b6e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:57.353216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e614c0-43a1-4305-b32d-346e15518b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:57.383871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b9e614c0-43a1-4305-b32d-346e15518b6e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:57.385037 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b9e614c0-43a1-4305-b32d-346e15518b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:57.463409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1187/2361] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:57.473215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:57.474646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:57.540849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8510bb-7dc5-4fa9-b66c-08f1db786bc1 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:57.545182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda03f0-657e-4994-a418-6afb7f73b9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:57.545835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda03f0-657e-4994-a418-6afb7f73b9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:57.546116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda03f0-657e-4994-a418-6afb7f73b9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:57.546388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda03f0-657e-4994-a418-6afb7f73b9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:57.556424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda03f0-657e-4994-a418-6afb7f73b9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:57.557877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda03f0-657e-4994-a418-6afb7f73b9b0 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:57.568503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1175/2362] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:57.852608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e614c0-43a1-4305-b32d-346e15518b6e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:57.854101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b9e614c0-43a1-4305-b32d-346e15518b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:57.866804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e614c0-43a1-4305-b32d-346e15518b6e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:57.871531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:57.872408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:57.872694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:57.872974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] PATH_INFO: `/v3/projects/a6da5b1025f0424697bbc39480381efc` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:57.874213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6da5b1025f0424697bbc39480381efc)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:57.876834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:57.929776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6da5b1025f0424697bbc39480381efc', 'request_id': 'req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:57.942686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6da5b1025f0424697bbc39480381efc', 'request_id': 'req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:57.950829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6da5b1025f0424697bbc39480381efc', 'request_id': 'req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:57.971257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] The token cache is being invalidate because project a6da5b1025f0424697bbc39480381efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:33:57.971765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:57.972819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-566bafb4-0bd8-4214-8ee8-50a0d2dc3049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:33:57.975635 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1188/2363] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:33:57 2022] DELETE /identity/v3/projects/a6da5b1025f0424697bbc39480381efc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:33:57.982484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc202630-dd88-4a2f-88c8-f8e44f823ec9 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:57.982860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc202630-dd88-4a2f-88c8-f8e44f823ec9 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:57.983258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc202630-dd88-4a2f-88c8-f8e44f823ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:58.016873 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-bc202630-dd88-4a2f-88c8-f8e44f823ec9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:58.018112 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bc202630-dd88-4a2f-88c8-f8e44f823ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:58.104885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1176/2364] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:58.109247 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b491f5b-e150-4d5f-95b6-8a22dbc1a5fa None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:58.109621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b491f5b-e150-4d5f-95b6-8a22dbc1a5fa None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:58.110050 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b491f5b-e150-4d5f-95b6-8a22dbc1a5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:58.130922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-4b491f5b-e150-4d5f-95b6-8a22dbc1a5fa None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:58.132271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4b491f5b-e150-4d5f-95b6-8a22dbc1a5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:58.141266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1189/2365] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:33:58.145647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc202630-dd88-4a2f-88c8-f8e44f823ec9 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:58.157679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc202630-dd88-4a2f-88c8-f8e44f823ec9 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:58.162467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ad2c6-352a-464b-a888-71d328efd930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:58.163173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ad2c6-352a-464b-a888-71d328efd930 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:58.163461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ad2c6-352a-464b-a888-71d328efd930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:58.163744 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ad2c6-352a-464b-a888-71d328efd930 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:58.170727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ad2c6-352a-464b-a888-71d328efd930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:33:58.170727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ad2c6-352a-464b-a888-71d328efd930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:58.170727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ad2c6-352a-464b-a888-71d328efd930 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:58.179814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1177/2366] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:33:58.183994 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b491f5b-e150-4d5f-95b6-8a22dbc1a5fa None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:58.196241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b491f5b-e150-4d5f-95b6-8a22dbc1a5fa None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:58.207396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85d981-80fd-437d-bc25-b743851ab719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:58.208299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85d981-80fd-437d-bc25-b743851ab719 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:58.208652 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85d981-80fd-437d-bc25-b743851ab719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:58.208927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85d981-80fd-437d-bc25-b743851ab719 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:58.210176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85d981-80fd-437d-bc25-b743851ab719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:58.212193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85d981-80fd-437d-bc25-b743851ab719 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:58.246674 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1190/2367] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:33:58 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:33:58.247824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ad2c6-352a-464b-a888-71d328efd930 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:58.258338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ad2c6-352a-464b-a888-71d328efd930 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:58.319344 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ea2d4-a55e-42c9-9ce9-01866f48171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:58.320057 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ea2d4-a55e-42c9-9ce9-01866f48171a admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:58.320343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ea2d4-a55e-42c9-9ce9-01866f48171a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:58.320649 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ea2d4-a55e-42c9-9ce9-01866f48171a admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:58.321346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ea2d4-a55e-42c9-9ce9-01866f48171a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:58.323331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ea2d4-a55e-42c9-9ce9-01866f48171a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:58.345133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1178/2368] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:33:58 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:33:58.349503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85d981-80fd-437d-bc25-b743851ab719 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:58.362252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85d981-80fd-437d-bc25-b743851ab719 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:58.369928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3091ddd-468e-448d-a8f7-3ccfc46141ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:58.370922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3091ddd-468e-448d-a8f7-3ccfc46141ef admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:58.371245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3091ddd-468e-448d-a8f7-3ccfc46141ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:58.371522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3091ddd-468e-448d-a8f7-3ccfc46141ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:58.372275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3091ddd-468e-448d-a8f7-3ccfc46141ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:58.373931 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3091ddd-468e-448d-a8f7-3ccfc46141ef admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:58.385875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1191/2369] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:58.390035 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ea2d4-a55e-42c9-9ce9-01866f48171a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:58.402380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ea2d4-a55e-42c9-9ce9-01866f48171a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:58.408025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f01bfe-1f15-45d5-927b-f66bec22266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:58.409013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f01bfe-1f15-45d5-927b-f66bec22266f admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:58.409292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f01bfe-1f15-45d5-927b-f66bec22266f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:58.409571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f01bfe-1f15-45d5-927b-f66bec22266f admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:58.410319 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f01bfe-1f15-45d5-927b-f66bec22266f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:58.411973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f01bfe-1f15-45d5-927b-f66bec22266f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:58.426911 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1179/2370] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:33:58.429140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3091ddd-468e-448d-a8f7-3ccfc46141ef admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:58.440223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3091ddd-468e-448d-a8f7-3ccfc46141ef admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:58.446288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef5856-bff4-4071-8097-97536b1999cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:58.447827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef5856-bff4-4071-8097-97536b1999cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:58.448437 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef5856-bff4-4071-8097-97536b1999cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:58.448962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef5856-bff4-4071-8097-97536b1999cf admin admin] PATH_INFO: `/v3/projects/4bd10bf39df949fcb23d1ff0ffc86ecf/users/49ae13fc26594767a7c8f2615ebaafbb/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:58.466702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef5856-bff4-4071-8097-97536b1999cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd10bf39df949fcb23d1ff0ffc86ecf, user_id=49ae13fc26594767a7c8f2615ebaafbb, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:58.470289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef5856-bff4-4071-8097-97536b1999cf admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:58.484599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1192/2371] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:33:58 2022] PUT /identity/v3/projects/4bd10bf39df949fcb23d1ff0ffc86ecf/users/49ae13fc26594767a7c8f2615ebaafbb/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:33:58.494844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e3236-00d1-47b4-89c8-f068b9e5d9a1 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:58.495237 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e3236-00d1-47b4-89c8-f068b9e5d9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:58.495593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e3236-00d1-47b4-89c8-f068b9e5d9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:58.526585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-180e3236-00d1-47b4-89c8-f068b9e5d9a1 None None] MFA Rules not processed for user `49ae13fc26594767a7c8f2615ebaafbb`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:58.527890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-180e3236-00d1-47b4-89c8-f068b9e5d9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:58.608438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1180/2372] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:33:58.622317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef5856-bff4-4071-8097-97536b1999cf admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:33:58.625040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6bef5856-bff4-4071-8097-97536b1999cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:58.713474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef5856-bff4-4071-8097-97536b1999cf admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:33:58.717339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974b7f3-1a86-496e-8630-8a154bc86d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:33:58.717919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974b7f3-1a86-496e-8630-8a154bc86d5c service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:58.718204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974b7f3-1a86-496e-8630-8a154bc86d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:58.718481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974b7f3-1a86-496e-8630-8a154bc86d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:58.728316 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974b7f3-1a86-496e-8630-8a154bc86d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:33:58.729776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974b7f3-1a86-496e-8630-8a154bc86d5c service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:33:58.739427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1193/2373] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:33:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:33:59.087936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865e917-531f-4e19-9881-f02870f782bb None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:33:59.088248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865e917-531f-4e19-9881-f02870f782bb None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:33:59.088883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865e917-531f-4e19-9881-f02870f782bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:33:59.108682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c865e917-531f-4e19-9881-f02870f782bb None None] MFA Rules not processed for user `a64c3ea69151401897e4203095676543`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:33:59.112515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c865e917-531f-4e19-9881-f02870f782bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:33:59.181024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1181/2374] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:15.610442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142cefa-4b2a-4af6-940d-05f1f1a480dc None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:15.610919 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142cefa-4b2a-4af6-940d-05f1f1a480dc None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:15.611265 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142cefa-4b2a-4af6-940d-05f1f1a480dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:15.669962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b142cefa-4b2a-4af6-940d-05f1f1a480dc None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:15.671220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b142cefa-4b2a-4af6-940d-05f1f1a480dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:15.747609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1194/2375] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:34:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:15.794171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865e917-531f-4e19-9881-f02870f782bb None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:15.796067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c865e917-531f-4e19-9881-f02870f782bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:15.900056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865e917-531f-4e19-9881-f02870f782bb None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:15.905458 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7493b-ffeb-43a1-a7c6-8667068a6061 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:15.906793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7493b-ffeb-43a1-a7c6-8667068a6061 service swift] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:15.907277 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7493b-ffeb-43a1-a7c6-8667068a6061 service swift] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:15.907663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7493b-ffeb-43a1-a7c6-8667068a6061 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:15.918285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7493b-ffeb-43a1-a7c6-8667068a6061 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:15.919994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7493b-ffeb-43a1-a7c6-8667068a6061 service swift] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:15.929600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1182/2376] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:34:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:34:16.568447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e981-8b2a-404b-b111-66607a61c29a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:16.568924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e981-8b2a-404b-b111-66607a61c29a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:16.569454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e981-8b2a-404b-b111-66607a61c29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:16.617394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-45f0e981-8b2a-404b-b111-66607a61c29a None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:16.618823 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-45f0e981-8b2a-404b-b111-66607a61c29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:16.629497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1195/2377] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 12 14:34:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:16.648715 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7493b-ffeb-43a1-a7c6-8667068a6061 service swift] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:16.663645 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7493b-ffeb-43a1-a7c6-8667068a6061 service swift] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:16.669235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddd073-f58f-4704-8c63-92dc0ade2522 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:16.669984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddd073-f58f-4704-8c63-92dc0ade2522 service swift] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:16.670979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddd073-f58f-4704-8c63-92dc0ade2522 service swift] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:16.671373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddd073-f58f-4704-8c63-92dc0ade2522 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:16.682321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddd073-f58f-4704-8c63-92dc0ade2522 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:16.684632 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddd073-f58f-4704-8c63-92dc0ade2522 service swift] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:16.695246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1183/2378] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:34:16.898459 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0e966-f528-40eb-8247-7f14989fd0da None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:16.898749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0e966-f528-40eb-8247-7f14989fd0da None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:16.899046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0e966-f528-40eb-8247-7f14989fd0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:16.916409 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d3f0e966-f528-40eb-8247-7f14989fd0da None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:16.917611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d3f0e966-f528-40eb-8247-7f14989fd0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:16.924878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1196/2379] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:34:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:16.942747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddd073-f58f-4704-8c63-92dc0ade2522 service swift] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:16.954436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddd073-f58f-4704-8c63-92dc0ade2522 service swift] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:16.959605 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096531b-7b37-4dec-a570-d82ba2f40ef3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:16.960244 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096531b-7b37-4dec-a570-d82ba2f40ef3 service swift] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:16.960527 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096531b-7b37-4dec-a570-d82ba2f40ef3 service swift] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:16.960805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096531b-7b37-4dec-a570-d82ba2f40ef3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:16.969329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096531b-7b37-4dec-a570-d82ba2f40ef3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:16.970909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096531b-7b37-4dec-a570-d82ba2f40ef3 service swift] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:16.979100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1184/2380] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 14:34:17.339659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bb639-bb8f-4756-84a9-02dd3a100816 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:17.339892 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bb639-bb8f-4756-84a9-02dd3a100816 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:17.340253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bb639-bb8f-4756-84a9-02dd3a100816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:17.358241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-1c6bb639-bb8f-4756-84a9-02dd3a100816 None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:17.359498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1c6bb639-bb8f-4756-84a9-02dd3a100816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:17.366554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1197/2381] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 12 14:34:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:17.379230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096531b-7b37-4dec-a570-d82ba2f40ef3 service swift] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:17.389633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096531b-7b37-4dec-a570-d82ba2f40ef3 service swift] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:17.395153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb988a18-2369-4af2-aab8-07276ca36c22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:17.395793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb988a18-2369-4af2-aab8-07276ca36c22 service swift] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:17.396076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb988a18-2369-4af2-aab8-07276ca36c22 service swift] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:17.396354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb988a18-2369-4af2-aab8-07276ca36c22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:17.404176 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb988a18-2369-4af2-aab8-07276ca36c22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:17.405757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb988a18-2369-4af2-aab8-07276ca36c22 service swift] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:17.414242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1185/2382] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:34:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 14:34:19.541028 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bb639-bb8f-4756-84a9-02dd3a100816 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:19.542424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1c6bb639-bb8f-4756-84a9-02dd3a100816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:19.609101 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bb639-bb8f-4756-84a9-02dd3a100816 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:19.614261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:19.615171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:19.615450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:19.615722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] PATH_INFO: `/v3/users/34b98d85325b4ea194c06848e508ad7a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:19.616988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b98d85325b4ea194c06848e508ad7a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:19.618950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:19.663303 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b98d85325b4ea194c06848e508ad7a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:34:19.669878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b98d85325b4ea194c06848e508ad7a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:34:19.670533 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b98d85325b4ea194c06848e508ad7a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:34:19.671167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b98d85325b4ea194c06848e508ad7a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:34:19.684007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b98d85325b4ea194c06848e508ad7a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:34:19.697401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1198/2383] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:34:19 2022] DELETE /identity/v3/users/34b98d85325b4ea194c06848e508ad7a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:34:19.701854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9379-1536-43e2-9af6-290ce93338ed None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:19.702350 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9379-1536-43e2-9af6-290ce93338ed None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:19.702472 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e9379-1536-43e2-9af6-290ce93338ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:19.720065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-a08e9379-1536-43e2-9af6-290ce93338ed None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:19.721314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a08e9379-1536-43e2-9af6-290ce93338ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:19.781049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1186/2384] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:19.791590 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:19.793198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:19.852854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead728-8c32-4ee8-b37d-3fda3106684f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:19.856694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01b8d8-3679-4f45-8372-b2accc495112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:19.857345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b8d8-3679-4f45-8372-b2accc495112 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:19.857627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b8d8-3679-4f45-8372-b2accc495112 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:19.857902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01b8d8-3679-4f45-8372-b2accc495112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:19.867616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01b8d8-3679-4f45-8372-b2accc495112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:19.869047 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01b8d8-3679-4f45-8372-b2accc495112 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:19.879140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1199/2385] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:34:20.046517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e9379-1536-43e2-9af6-290ce93338ed None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:20.048710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a08e9379-1536-43e2-9af6-290ce93338ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:20.060894 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e9379-1536-43e2-9af6-290ce93338ed None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:20.065890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:20.067552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.067552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.067552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] PATH_INFO: `/v3/projects/2089564feda44bac86715eed2cf285f1` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.068933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2089564feda44bac86715eed2cf285f1)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:20.071346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:20.120081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2089564feda44bac86715eed2cf285f1', 'request_id': 'req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:34:20.126635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2089564feda44bac86715eed2cf285f1', 'request_id': 'req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:34:20.132357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2089564feda44bac86715eed2cf285f1', 'request_id': 'req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:34:20.145202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] The token cache is being invalidate because project 2089564feda44bac86715eed2cf285f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:34:20.145493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:34:20.146118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-73f09ed4-6a8a-42bb-b282-dd1bcd3a0d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:34:20.147747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1187/2386] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:34:20 2022] DELETE /identity/v3/projects/2089564feda44bac86715eed2cf285f1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:34:20.152742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b195b4-add6-4162-92d8-ab835c87182c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.153036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b195b4-add6-4162-92d8-ab835c87182c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.153321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b195b4-add6-4162-92d8-ab835c87182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.178015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-75b195b4-add6-4162-92d8-ab835c87182c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:20.179294 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-75b195b4-add6-4162-92d8-ab835c87182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:20.237646 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1200/2387] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:20.245423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466928e-065e-4a89-a26e-aa489c33f88d None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.245714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466928e-065e-4a89-a26e-aa489c33f88d None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.245992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466928e-065e-4a89-a26e-aa489c33f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.264941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5466928e-065e-4a89-a26e-aa489c33f88d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:20.266651 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5466928e-065e-4a89-a26e-aa489c33f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:20.274894 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1188/2388] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:20.279138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b195b4-add6-4162-92d8-ab835c87182c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:20.289320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b195b4-add6-4162-92d8-ab835c87182c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:20.293881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a03dd2-d1e1-44b4-8565-bfab2e09cbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:20.294469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03dd2-d1e1-44b4-8565-bfab2e09cbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.294753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03dd2-d1e1-44b4-8565-bfab2e09cbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.295046 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a03dd2-d1e1-44b4-8565-bfab2e09cbc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.295787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a03dd2-d1e1-44b4-8565-bfab2e09cbc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:34:20.296095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a03dd2-d1e1-44b4-8565-bfab2e09cbc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:20.297728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a03dd2-d1e1-44b4-8565-bfab2e09cbc1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:20.308644 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1201/2389] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:34:20.312704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466928e-065e-4a89-a26e-aa489c33f88d None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:20.321846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466928e-065e-4a89-a26e-aa489c33f88d None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:20.326887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461647-b630-4198-bdb6-7916ae19c6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:20.327598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461647-b630-4198-bdb6-7916ae19c6db admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.328754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461647-b630-4198-bdb6-7916ae19c6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.328754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00461647-b630-4198-bdb6-7916ae19c6db admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.332061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00461647-b630-4198-bdb6-7916ae19c6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:20.332061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00461647-b630-4198-bdb6-7916ae19c6db admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:20.359080 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1189/2390] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:34:20 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:34:20.361996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a03dd2-d1e1-44b4-8565-bfab2e09cbc1 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:20.372558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a03dd2-d1e1-44b4-8565-bfab2e09cbc1 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:20.427392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7316a-e6c7-4d47-a777-8ecd979da4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:20.428061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7316a-e6c7-4d47-a777-8ecd979da4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.428343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7316a-e6c7-4d47-a777-8ecd979da4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.428618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7316a-e6c7-4d47-a777-8ecd979da4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.429305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7316a-e6c7-4d47-a777-8ecd979da4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:20.431270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7316a-e6c7-4d47-a777-8ecd979da4c7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:20.449631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1202/2391] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:34:20 2022] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:34:20.456036 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461647-b630-4198-bdb6-7916ae19c6db admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:20.471269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00461647-b630-4198-bdb6-7916ae19c6db admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:20.479639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666423-9779-4843-8a12-7764a4b5f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:20.480978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666423-9779-4843-8a12-7764a4b5f843 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.481273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666423-9779-4843-8a12-7764a4b5f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.481556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54666423-9779-4843-8a12-7764a4b5f843 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.482294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54666423-9779-4843-8a12-7764a4b5f843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:20.484315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54666423-9779-4843-8a12-7764a4b5f843 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:20.502190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7316a-e6c7-4d47-a777-8ecd979da4c7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:20.507187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1190/2392] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:34:20.512933 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7316a-e6c7-4d47-a777-8ecd979da4c7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:20.519940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7288ca-b202-4ce3-b461-e7f8b1ff41b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:20.521630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7288ca-b202-4ce3-b461-e7f8b1ff41b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.521932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7288ca-b202-4ce3-b461-e7f8b1ff41b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.522215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7288ca-b202-4ce3-b461-e7f8b1ff41b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.522974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7288ca-b202-4ce3-b461-e7f8b1ff41b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:20.527290 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7288ca-b202-4ce3-b461-e7f8b1ff41b4 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:20.542530 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1203/2393] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:34:20.544002 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666423-9779-4843-8a12-7764a4b5f843 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:20.555556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54666423-9779-4843-8a12-7764a4b5f843 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:20.561420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2051190-d7b7-4836-aba4-1cd7345c1340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:20.562920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051190-d7b7-4836-aba4-1cd7345c1340 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.563235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051190-d7b7-4836-aba4-1cd7345c1340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.563513 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2051190-d7b7-4836-aba4-1cd7345c1340 admin admin] PATH_INFO: `/v3/projects/d9bb0671fa894da79848c7c46e553b5e/users/4a65b858f4644a619a9c34cb99251efb/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.580164 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2051190-d7b7-4836-aba4-1cd7345c1340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bb0671fa894da79848c7c46e553b5e, user_id=4a65b858f4644a619a9c34cb99251efb, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:20.582892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2051190-d7b7-4836-aba4-1cd7345c1340 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:20.599078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1191/2394] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:34:20 2022] PUT /identity/v3/projects/d9bb0671fa894da79848c7c46e553b5e/users/4a65b858f4644a619a9c34cb99251efb/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:34:20.601649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85d157-667a-410b-b137-993074067cae None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.601941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85d157-667a-410b-b137-993074067cae None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.602223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85d157-667a-410b-b137-993074067cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.619739 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-dd85d157-667a-410b-b137-993074067cae None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:20.620959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-dd85d157-667a-410b-b137-993074067cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:20.683620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1204/2395] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:20.694399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2051190-d7b7-4836-aba4-1cd7345c1340 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:20.696317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c2051190-d7b7-4836-aba4-1cd7345c1340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:20.754763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2051190-d7b7-4836-aba4-1cd7345c1340 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:20.758526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2730b4-c66f-44cd-9a9b-bcee8942216e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:20.759534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2730b4-c66f-44cd-9a9b-bcee8942216e service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:20.759976 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2730b4-c66f-44cd-9a9b-bcee8942216e service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:20.760424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2730b4-c66f-44cd-9a9b-bcee8942216e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:20.774591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2730b4-c66f-44cd-9a9b-bcee8942216e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:20.776408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2730b4-c66f-44cd-9a9b-bcee8942216e service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:20.789077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1192/2396] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:34:25.518662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c5da-75b2-4903-a5e5-cbdfc92c8bb1 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:25.519283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c5da-75b2-4903-a5e5-cbdfc92c8bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:25.519283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017c5da-75b2-4903-a5e5-cbdfc92c8bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:25.565201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b017c5da-75b2-4903-a5e5-cbdfc92c8bb1 None None] MFA Rules not processed for user `4a65b858f4644a619a9c34cb99251efb`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:25.566605 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b017c5da-75b2-4903-a5e5-cbdfc92c8bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:25.662630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1205/2397] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:34:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:25.666861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2730b4-c66f-44cd-9a9b-bcee8942216e service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:25.677947 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2730b4-c66f-44cd-9a9b-bcee8942216e service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:25.682733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026d283-5dc6-44f3-8f83-9735fd2e75ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:25.683444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d283-5dc6-44f3-8f83-9735fd2e75ff admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:25.683748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d283-5dc6-44f3-8f83-9735fd2e75ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:25.684004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d283-5dc6-44f3-8f83-9735fd2e75ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:25.684703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026d283-5dc6-44f3-8f83-9735fd2e75ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:25.686606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9026d283-5dc6-44f3-8f83-9735fd2e75ff admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:25.718359 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1193/2398] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:34:25 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:34:25.722402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017c5da-75b2-4903-a5e5-cbdfc92c8bb1 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:25.733754 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017c5da-75b2-4903-a5e5-cbdfc92c8bb1 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:25.809147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a70b-516b-4449-a3e3-2e8d7d4c3b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:25.810634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a70b-516b-4449-a3e3-2e8d7d4c3b61 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:25.810912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a70b-516b-4449-a3e3-2e8d7d4c3b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:25.811327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522a70b-516b-4449-a3e3-2e8d7d4c3b61 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:25.812127 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522a70b-516b-4449-a3e3-2e8d7d4c3b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:25.815763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522a70b-516b-4449-a3e3-2e8d7d4c3b61 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:25.854760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1206/2399] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:34:25 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:34:25.866270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026d283-5dc6-44f3-8f83-9735fd2e75ff admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:25.877225 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026d283-5dc6-44f3-8f83-9735fd2e75ff admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:25.884836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04810362-8c83-4549-a9bd-ba3a62486c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:25.885558 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04810362-8c83-4549-a9bd-ba3a62486c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:25.885854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04810362-8c83-4549-a9bd-ba3a62486c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:25.886130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04810362-8c83-4549-a9bd-ba3a62486c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:25.886883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04810362-8c83-4549-a9bd-ba3a62486c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:25.888758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04810362-8c83-4549-a9bd-ba3a62486c46 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:25.902423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1194/2400] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:34:25.906932 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a70b-516b-4449-a3e3-2e8d7d4c3b61 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:25.919933 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522a70b-516b-4449-a3e3-2e8d7d4c3b61 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:25.926852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333dc46-71b6-4611-93da-c57e04e0f26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:25.927867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333dc46-71b6-4611-93da-c57e04e0f26e admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:25.928218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333dc46-71b6-4611-93da-c57e04e0f26e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:25.928599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333dc46-71b6-4611-93da-c57e04e0f26e admin admin] PATH_INFO: `/v3/projects/1fdc3cb330c641f8964219da72fbc161/users/7970929c436b4f608cb5c00e47c31024/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:25.950966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333dc46-71b6-4611-93da-c57e04e0f26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdc3cb330c641f8964219da72fbc161, user_id=7970929c436b4f608cb5c00e47c31024, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:25.955515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333dc46-71b6-4611-93da-c57e04e0f26e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:25.977068 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1207/2401] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:34:25 2022] PUT /identity/v3/projects/1fdc3cb330c641f8964219da72fbc161/users/7970929c436b4f608cb5c00e47c31024/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:34:25.981942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04810362-8c83-4549-a9bd-ba3a62486c46 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:26.001418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04810362-8c83-4549-a9bd-ba3a62486c46 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:26.080525 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6451a-e81c-4ab4-888a-fda311176e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:26.081201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6451a-e81c-4ab4-888a-fda311176e67 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:26.081482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6451a-e81c-4ab4-888a-fda311176e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:26.081757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6451a-e81c-4ab4-888a-fda311176e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:26.082517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6451a-e81c-4ab4-888a-fda311176e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:26.084181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6451a-e81c-4ab4-888a-fda311176e67 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:26.095076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1195/2402] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:34:26.099058 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333dc46-71b6-4611-93da-c57e04e0f26e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:26.110700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333dc46-71b6-4611-93da-c57e04e0f26e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:26.115395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea594c65-48f5-444f-8de1-2525b72310a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:26.116266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea594c65-48f5-444f-8de1-2525b72310a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:26.116545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea594c65-48f5-444f-8de1-2525b72310a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:26.116816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea594c65-48f5-444f-8de1-2525b72310a1 admin admin] PATH_INFO: `/v3/projects/1fdc3cb330c641f8964219da72fbc161/users/7970929c436b4f608cb5c00e47c31024/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:26.118774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea594c65-48f5-444f-8de1-2525b72310a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdc3cb330c641f8964219da72fbc161, user_id=7970929c436b4f608cb5c00e47c31024, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:26.121509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea594c65-48f5-444f-8de1-2525b72310a1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:26.136812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1208/2403] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:34:26 2022] PUT /identity/v3/projects/1fdc3cb330c641f8964219da72fbc161/users/7970929c436b4f608cb5c00e47c31024/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:34:32.352372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fc80c-dc93-4d9d-a669-9310a2405e9f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:32.352910 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fc80c-dc93-4d9d-a669-9310a2405e9f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:32.353119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035fc80c-dc93-4d9d-a669-9310a2405e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:32.381555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-035fc80c-dc93-4d9d-a669-9310a2405e9f None None] MFA Rules not processed for user `7970929c436b4f608cb5c00e47c31024`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:32.382775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-035fc80c-dc93-4d9d-a669-9310a2405e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:32.463950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1196/2404] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:34:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:34:32.477942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea594c65-48f5-444f-8de1-2525b72310a1 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:32.479639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-ea594c65-48f5-444f-8de1-2525b72310a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:32.574615 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea594c65-48f5-444f-8de1-2525b72310a1 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:32.580864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba1cce-ef9d-430e-891a-d7cc227c0b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:32.581514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1cce-ef9d-430e-891a-d7cc227c0b24 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:32.581808 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1cce-ef9d-430e-891a-d7cc227c0b24 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:32.582087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba1cce-ef9d-430e-891a-d7cc227c0b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:32.638377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba1cce-ef9d-430e-891a-d7cc227c0b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:32.640575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba1cce-ef9d-430e-891a-d7cc227c0b24 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:32.649988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1209/2405] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:34:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:34:34.865921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a5ee-1fe0-4c39-a7e5-92d75eec876f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:34.867136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a5ee-1fe0-4c39-a7e5-92d75eec876f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:34.867921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5a5ee-1fe0-4c39-a7e5-92d75eec876f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:34.914886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-7ba5a5ee-1fe0-4c39-a7e5-92d75eec876f None None] MFA Rules not processed for user `4a65b858f4644a619a9c34cb99251efb`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:34.916386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7ba5a5ee-1fe0-4c39-a7e5-92d75eec876f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:34.931274 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1197/2406] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:34:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:35.775485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba1cce-ef9d-430e-891a-d7cc227c0b24 service nova] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:35.832488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba1cce-ef9d-430e-891a-d7cc227c0b24 service nova] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:35.836019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25d653-b15e-459b-a31d-08f24e05d529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:35.836663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25d653-b15e-459b-a31d-08f24e05d529 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:35.836938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25d653-b15e-459b-a31d-08f24e05d529 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:35.837212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25d653-b15e-459b-a31d-08f24e05d529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:35.838966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5c25d653-b15e-459b-a31d-08f24e05d529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:35.898712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25d653-b15e-459b-a31d-08f24e05d529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:35.900177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25d653-b15e-459b-a31d-08f24e05d529 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:35.910616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1210/2407] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:34:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:34:47.441093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db960-6f88-4b4c-9ca2-a8b8572735e1 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:47.441697 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db960-6f88-4b4c-9ca2-a8b8572735e1 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:47.441697 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106db960-6f88-4b4c-9ca2-a8b8572735e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:47.461538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-106db960-6f88-4b4c-9ca2-a8b8572735e1 None None] MFA Rules not processed for user `c6422873a3b84aac88f8a93291bcd7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:34:47.463327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-106db960-6f88-4b4c-9ca2-a8b8572735e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:47.559552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1198/2408] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:34:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:34:51.297606 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25d653-b15e-459b-a31d-08f24e05d529 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:34:51.298999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5c25d653-b15e-459b-a31d-08f24e05d529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:51.389067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25d653-b15e-459b-a31d-08f24e05d529 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:34:51.394828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b5052-1e44-428d-9d87-430b49223db2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3004f3e4a9854502be59119e17e04961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:34:51.395510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5052-1e44-428d-9d87-430b49223db2 service placement] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:34:51.395797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5052-1e44-428d-9d87-430b49223db2 service placement] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:34:51.396074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b5052-1e44-428d-9d87-430b49223db2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:34:51.397897 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-ee6b5052-1e44-428d-9d87-430b49223db2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:34:51.410949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b5052-1e44-428d-9d87-430b49223db2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:34:51.412819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b5052-1e44-428d-9d87-430b49223db2 service placement] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:34:51.423308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1211/2409] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:34:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:35:11.275700 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106db960-6f88-4b4c-9ca2-a8b8572735e1 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:11.277135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-106db960-6f88-4b4c-9ca2-a8b8572735e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:11.350264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106db960-6f88-4b4c-9ca2-a8b8572735e1 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:11.355406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:11.356294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:11.356578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:11.356854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] PATH_INFO: `/v3/users/49ae13fc26594767a7c8f2615ebaafbb` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:11.358065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ae13fc26594767a7c8f2615ebaafbb)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:11.360050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:11.413532 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ae13fc26594767a7c8f2615ebaafbb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:35:11.414231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ae13fc26594767a7c8f2615ebaafbb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:35:11.425246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ae13fc26594767a7c8f2615ebaafbb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:35:11.425929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ae13fc26594767a7c8f2615ebaafbb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:35:11.435093 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ae13fc26594767a7c8f2615ebaafbb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:35:11.455421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1199/2410] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:35:11 2022] DELETE /identity/v3/users/49ae13fc26594767a7c8f2615ebaafbb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:35:11.460087 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97bf2-855f-4136-a865-cbdebac769f9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:11.460610 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97bf2-855f-4136-a865-cbdebac769f9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:11.460742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97bf2-855f-4136-a865-cbdebac769f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:11.478509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c3a97bf2-855f-4136-a865-cbdebac769f9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:11.479757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c3a97bf2-855f-4136-a865-cbdebac769f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:11.536877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1212/2411] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:11.546406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:11.547847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:11.602589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32e846-7ec3-4769-bd86-51e9b286dd6f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:11.606521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a69525-58b0-4d21-8800-b5f41c72c40b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:11.607187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a69525-58b0-4d21-8800-b5f41c72c40b service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:11.607476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a69525-58b0-4d21-8800-b5f41c72c40b service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:11.607753 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a69525-58b0-4d21-8800-b5f41c72c40b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:11.617616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a69525-58b0-4d21-8800-b5f41c72c40b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:11.619061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a69525-58b0-4d21-8800-b5f41c72c40b service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:11.629847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1200/2412] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:35:11.922221 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97bf2-855f-4136-a865-cbdebac769f9 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:11.924542 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c3a97bf2-855f-4136-a865-cbdebac769f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:11.937769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97bf2-855f-4136-a865-cbdebac769f9 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:11.943162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:11.944229 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:11.944681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:11.945141 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] PATH_INFO: `/v3/projects/4bd10bf39df949fcb23d1ff0ffc86ecf` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:11.946676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd10bf39df949fcb23d1ff0ffc86ecf)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:11.949126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:12.005446 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd10bf39df949fcb23d1ff0ffc86ecf', 'request_id': 'req-8bcf4d10-432b-4e10-b674-ce89a1bf44df'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:35:12.012557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd10bf39df949fcb23d1ff0ffc86ecf', 'request_id': 'req-8bcf4d10-432b-4e10-b674-ce89a1bf44df'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:35:12.022045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd10bf39df949fcb23d1ff0ffc86ecf', 'request_id': 'req-8bcf4d10-432b-4e10-b674-ce89a1bf44df'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:35:12.034558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] The token cache is being invalidate because project 4bd10bf39df949fcb23d1ff0ffc86ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:35:12.034849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:35:12.035570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:35:12.037129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1213/2413] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:35:11 2022] DELETE /identity/v3/projects/4bd10bf39df949fcb23d1ff0ffc86ecf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:35:40.592718 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea307f-1f81-41c7-93e7-5f420afe0a90 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:40.593247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea307f-1f81-41c7-93e7-5f420afe0a90 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:40.593363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea307f-1f81-41c7-93e7-5f420afe0a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:40.612011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-ddea307f-1f81-41c7-93e7-5f420afe0a90 None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:40.613354 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ddea307f-1f81-41c7-93e7-5f420afe0a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:40.676557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1201/2414] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:40.729779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:35:40.731398 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:40.810505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf4d10-432b-4e10-b674-ce89a1bf44df admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:35:40.818008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb509575-a9e6-4ac4-8969-6b6dddfe3fbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:35:40.818687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb509575-a9e6-4ac4-8969-6b6dddfe3fbd service swift] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:40.818984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb509575-a9e6-4ac4-8969-6b6dddfe3fbd service swift] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:40.819299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb509575-a9e6-4ac4-8969-6b6dddfe3fbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:40.829173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb509575-a9e6-4ac4-8969-6b6dddfe3fbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:35:40.830797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb509575-a9e6-4ac4-8969-6b6dddfe3fbd service swift] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:35:40.846578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1214/2415] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:35:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 14:35:54.709179 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543b2c9-97bc-402a-b9f9-61b73160f22b None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:54.710130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543b2c9-97bc-402a-b9f9-61b73160f22b None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:54.710647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543b2c9-97bc-402a-b9f9-61b73160f22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:54.732038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-4543b2c9-97bc-402a-b9f9-61b73160f22b None None] MFA Rules not processed for user `2cfa47f1da4e4ae9a358e2b8ace795ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:54.734652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4543b2c9-97bc-402a-b9f9-61b73160f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:54.805544 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1202/2416] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:35:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:35:59.298145 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73541-d09c-4161-b55d-9e4fb739d5fa None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:35:59.298688 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73541-d09c-4161-b55d-9e4fb739d5fa None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:35:59.298688 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73541-d09c-4161-b55d-9e4fb739d5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:35:59.316849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-18e73541-d09c-4161-b55d-9e4fb739d5fa None None] MFA Rules not processed for user `e6fa3252d9f04964b481dd02b378d072`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:35:59.318104 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-18e73541-d09c-4161-b55d-9e4fb739d5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:35:59.372192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1215/2417] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:35:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:36:02.884374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6480c3c-8f92-4947-93f0-b863f59393c6 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:02.884962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6480c3c-8f92-4947-93f0-b863f59393c6 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:02.884962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6480c3c-8f92-4947-93f0-b863f59393c6 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:02.886384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1203/2418] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:36:02.893192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86387b2-cb14-4fac-8cfd-9fa610b9bc91 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:02.893741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86387b2-cb14-4fac-8cfd-9fa610b9bc91 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:02.893866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86387b2-cb14-4fac-8cfd-9fa610b9bc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:02.934563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f86387b2-cb14-4fac-8cfd-9fa610b9bc91 None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:36:02.937127 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f86387b2-cb14-4fac-8cfd-9fa610b9bc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:03.022842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1216/2419] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:36:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:36:03.035809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6480c3c-8f92-4947-93f0-b863f59393c6 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:03.037566 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b6480c3c-8f92-4947-93f0-b863f59393c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:03.143557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6480c3c-8f92-4947-93f0-b863f59393c6 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:03.147418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fed361a-c51c-46a7-8c8d-8652fd902d4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10414e35df26406786eaf49c52661cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:03.148129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed361a-c51c-46a7-8c8d-8652fd902d4a service glance] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:03.148414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed361a-c51c-46a7-8c8d-8652fd902d4a service glance] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:03.148690 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed361a-c51c-46a7-8c8d-8652fd902d4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:03.161119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed361a-c51c-46a7-8c8d-8652fd902d4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:03.162660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fed361a-c51c-46a7-8c8d-8652fd902d4a service glance] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:03.175198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1204/2420] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:36:03.254712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd00a-ab52-4d57-9e87-c35a320cb3d8 None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:03.255065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd00a-ab52-4d57-9e87-c35a320cb3d8 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:03.255309 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd00a-ab52-4d57-9e87-c35a320cb3d8 None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:03.256650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1217/2421] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:36:03.262181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a4bba-6b7c-4aeb-92e2-493f3bd1477a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:03.262552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a4bba-6b7c-4aeb-92e2-493f3bd1477a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:03.262893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a4bba-6b7c-4aeb-92e2-493f3bd1477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:03.283603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-164a4bba-6b7c-4aeb-92e2-493f3bd1477a None None] MFA Rules not processed for user `5aca248c2e074fc4baff39930e21fe29`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:36:03.284810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-164a4bba-6b7c-4aeb-92e2-493f3bd1477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:03.337452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1205/2422] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:36:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:36:03.350481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dd00a-ab52-4d57-9e87-c35a320cb3d8 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:03.352306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-625dd00a-ab52-4d57-9e87-c35a320cb3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:03.371716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dd00a-ab52-4d57-9e87-c35a320cb3d8 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:03.377965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc797d-7e34-4e38-a07e-0bb69f43c3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:03.378467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc797d-7e34-4e38-a07e-0bb69f43c3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:03.378858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc797d-7e34-4e38-a07e-0bb69f43c3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:03.379432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc797d-7e34-4e38-a07e-0bb69f43c3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:03.388328 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc797d-7e34-4e38-a07e-0bb69f43c3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:03.391024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc797d-7e34-4e38-a07e-0bb69f43c3c6 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:03.403799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1218/2423] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:36:03.489266 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcf6ff-2e97-4c73-9276-18f44be1e787 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:03.489621 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcf6ff-2e97-4c73-9276-18f44be1e787 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:03.491003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcf6ff-2e97-4c73-9276-18f44be1e787 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:03.493954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1206/2424] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:36:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:36:03.501545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7635c4-76ba-4195-844e-942aebfa425d None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:03.501864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7635c4-76ba-4195-844e-942aebfa425d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:03.502111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7635c4-76ba-4195-844e-942aebfa425d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:03.525890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-2d7635c4-76ba-4195-844e-942aebfa425d None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:36:03.527078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2d7635c4-76ba-4195-844e-942aebfa425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:03.537803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1219/2425] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:36:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:36:03.550128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcf6ff-2e97-4c73-9276-18f44be1e787 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:03.561102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcf6ff-2e97-4c73-9276-18f44be1e787 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:03.565527 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8270b-9e97-4193-abae-9b8881d22807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:03.566196 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8270b-9e97-4193-abae-9b8881d22807 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:03.566477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8270b-9e97-4193-abae-9b8881d22807 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:03.566747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8270b-9e97-4193-abae-9b8881d22807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:03.577248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8270b-9e97-4193-abae-9b8881d22807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:03.578674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8270b-9e97-4193-abae-9b8881d22807 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:03.589445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1207/2426] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:36:07.117672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7635c4-76ba-4195-844e-942aebfa425d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:07.119116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2d7635c4-76ba-4195-844e-942aebfa425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:07.130974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7635c4-76ba-4195-844e-942aebfa425d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:07.134547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540b1e-c307-4ced-a263-51bb82233127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:07.135227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540b1e-c307-4ced-a263-51bb82233127 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:07.135795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540b1e-c307-4ced-a263-51bb82233127 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:07.136097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540b1e-c307-4ced-a263-51bb82233127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:07.137824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cf540b1e-c307-4ced-a263-51bb82233127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:07.204128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf540b1e-c307-4ced-a263-51bb82233127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:07.205496 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf540b1e-c307-4ced-a263-51bb82233127 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:07.215810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1220/2427] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:36:16.246162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8270b-9e97-4193-abae-9b8881d22807 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:16.255908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8270b-9e97-4193-abae-9b8881d22807 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:16.259760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e6c17-56c4-462d-8bd3-4df8a3da79cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:16.260407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e6c17-56c4-462d-8bd3-4df8a3da79cf service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:16.260685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e6c17-56c4-462d-8bd3-4df8a3da79cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:16.261026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e6c17-56c4-462d-8bd3-4df8a3da79cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:16.262948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d24e6c17-56c4-462d-8bd3-4df8a3da79cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:16.278066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e6c17-56c4-462d-8bd3-4df8a3da79cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:16.279614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e6c17-56c4-462d-8bd3-4df8a3da79cf service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:16.291621 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1208/2428] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:36:17.321044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540b1e-c307-4ced-a263-51bb82233127 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:17.332899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540b1e-c307-4ced-a263-51bb82233127 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:17.339541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426dded-96b0-403b-8f69-3a025387243b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:17.340311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426dded-96b0-403b-8f69-3a025387243b service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:17.340671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426dded-96b0-403b-8f69-3a025387243b service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:17.341017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426dded-96b0-403b-8f69-3a025387243b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:17.343154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0426dded-96b0-403b-8f69-3a025387243b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:17.358136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426dded-96b0-403b-8f69-3a025387243b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:17.359767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426dded-96b0-403b-8f69-3a025387243b service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:17.373308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1221/2429] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:36:17.582670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59271-e8ba-4cfa-beb4-3410a0a9199e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:17.583195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59271-e8ba-4cfa-beb4-3410a0a9199e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:17.583536 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59271-e8ba-4cfa-beb4-3410a0a9199e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:17.602435 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b7f59271-e8ba-4cfa-beb4-3410a0a9199e None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:36:17.603724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b7f59271-e8ba-4cfa-beb4-3410a0a9199e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:17.612745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1209/2430] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:36:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:36:17.626981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426dded-96b0-403b-8f69-3a025387243b service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:17.642578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426dded-96b0-403b-8f69-3a025387243b service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:17.648185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06473997-d501-4e3c-a55b-62fd5080a9f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:17.648871 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06473997-d501-4e3c-a55b-62fd5080a9f6 service swift] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:17.649159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06473997-d501-4e3c-a55b-62fd5080a9f6 service swift] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:17.649445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06473997-d501-4e3c-a55b-62fd5080a9f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:17.658350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06473997-d501-4e3c-a55b-62fd5080a9f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:17.660026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06473997-d501-4e3c-a55b-62fd5080a9f6 service swift] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:17.669481 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1222/2431] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:36:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:36:27.214486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f59271-e8ba-4cfa-beb4-3410a0a9199e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:27.216526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b7f59271-e8ba-4cfa-beb4-3410a0a9199e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:27.233707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f59271-e8ba-4cfa-beb4-3410a0a9199e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:27.239622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b2ae-23a0-4ab6-9dac-70c081884d7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:27.240275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b2ae-23a0-4ab6-9dac-70c081884d7d service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:27.240554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b2ae-23a0-4ab6-9dac-70c081884d7d service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:27.240828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d1b2ae-23a0-4ab6-9dac-70c081884d7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:27.242599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c3d1b2ae-23a0-4ab6-9dac-70c081884d7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:27.301759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1b2ae-23a0-4ab6-9dac-70c081884d7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:27.303448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d1b2ae-23a0-4ab6-9dac-70c081884d7d service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:27.313988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1210/2432] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:36:40.626900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06473997-d501-4e3c-a55b-62fd5080a9f6 service swift] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:40.632407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b2ae-23a0-4ab6-9dac-70c081884d7d service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:40.637061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06473997-d501-4e3c-a55b-62fd5080a9f6 service swift] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:40.642358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47ed4-cb95-461b-a121-e73348c36718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:40.642613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d1b2ae-23a0-4ab6-9dac-70c081884d7d service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:40.643003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47ed4-cb95-461b-a121-e73348c36718 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:40.643317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47ed4-cb95-461b-a121-e73348c36718 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:40.643595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47ed4-cb95-461b-a121-e73348c36718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:40.645386 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-fea47ed4-cb95-461b-a121-e73348c36718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:36:40.646764 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8825-9aed-4a63-8e65-ae0b0de95f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:40.647452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8825-9aed-4a63-8e65-ae0b0de95f1f service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:40.647734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8825-9aed-4a63-8e65-ae0b0de95f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:40.648011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8825-9aed-4a63-8e65-ae0b0de95f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:40.656428 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea47ed4-cb95-461b-a121-e73348c36718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:40.657559 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f8825-9aed-4a63-8e65-ae0b0de95f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:40.657910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea47ed4-cb95-461b-a121-e73348c36718 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:40.659311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f8825-9aed-4a63-8e65-ae0b0de95f1f service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:40.667758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1223/2433] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:36:40.668581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47ed4-cb95-461b-a121-e73348c36718 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:40.670063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1211/2434] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:36:40.670807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8825-9aed-4a63-8e65-ae0b0de95f1f service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:36:40.677406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47ed4-cb95-461b-a121-e73348c36718 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:40.679046 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8825-9aed-4a63-8e65-ae0b0de95f1f service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:36:40.682822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e588c-2368-4a15-a6b6-9a629d90f2b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:40.683508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e588c-2368-4a15-a6b6-9a629d90f2b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:40.683954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e588c-2368-4a15-a6b6-9a629d90f2b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:40.684076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e588c-2368-4a15-a6b6-9a629d90f2b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:40.691679 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d91a9-d760-4f45-8ab7-c383b5a67972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:36:40.692253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d91a9-d760-4f45-8ab7-c383b5a67972 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:36:40.692540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d91a9-d760-4f45-8ab7-c383b5a67972 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:36:40.692844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d91a9-d760-4f45-8ab7-c383b5a67972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:36:40.692951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e588c-2368-4a15-a6b6-9a629d90f2b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:40.694465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e588c-2368-4a15-a6b6-9a629d90f2b8 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:40.701657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d91a9-d760-4f45-8ab7-c383b5a67972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:36:40.702650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d91a9-d760-4f45-8ab7-c383b5a67972 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:36:40.703634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1212/2435] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:36:40.711468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1224/2436] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:36:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:09.593974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1ce6-c6b2-4be1-887c-79133357b450 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:09.594501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1ce6-c6b2-4be1-887c-79133357b450 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:09.594603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1ce6-c6b2-4be1-887c-79133357b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:09.612113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5c2e1ce6-c6b2-4be1-887c-79133357b450 None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:09.613329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5c2e1ce6-c6b2-4be1-887c-79133357b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:09.620481 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1213/2437] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 12 14:37:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:09.643045 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d91a9-d760-4f45-8ab7-c383b5a67972 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:09.655708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d91a9-d760-4f45-8ab7-c383b5a67972 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:09.660638 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df05e9-d299-48d6-9f28-223bd577b286 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:09.661299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df05e9-d299-48d6-9f28-223bd577b286 service swift] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:09.661581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df05e9-d299-48d6-9f28-223bd577b286 service swift] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:09.661856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df05e9-d299-48d6-9f28-223bd577b286 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:09.670458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df05e9-d299-48d6-9f28-223bd577b286 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:09.672112 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df05e9-d299-48d6-9f28-223bd577b286 service swift] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:09.680216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1225/2438] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:37:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:37:19.277301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e1ce6-c6b2-4be1-887c-79133357b450 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:19.279213 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5c2e1ce6-c6b2-4be1-887c-79133357b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:19.297152 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e1ce6-c6b2-4be1-887c-79133357b450 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:19.303659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a828c-e59c-41da-9089-828d26a28c95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:19.304390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a828c-e59c-41da-9089-828d26a28c95 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:19.304678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a828c-e59c-41da-9089-828d26a28c95 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:19.304960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a828c-e59c-41da-9089-828d26a28c95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:19.307209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2f2a828c-e59c-41da-9089-828d26a28c95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:19.321070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a828c-e59c-41da-9089-828d26a28c95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:19.322666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a828c-e59c-41da-9089-828d26a28c95 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:19.334952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1214/2439] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:37:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:49.659447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df05e9-d299-48d6-9f28-223bd577b286 service swift] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:49.660889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-63df05e9-d299-48d6-9f28-223bd577b286 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:49.725711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df05e9-d299-48d6-9f28-223bd577b286 service swift] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:49.730155 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:49.731001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:49.731315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:49.731583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] PATH_INFO: `/v3/users/e6fa3252d9f04964b481dd02b378d072` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:49.732752 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6fa3252d9f04964b481dd02b378d072)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:49.735276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:49.778322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6fa3252d9f04964b481dd02b378d072'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:49.785226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6fa3252d9f04964b481dd02b378d072'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:49.785900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6fa3252d9f04964b481dd02b378d072'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:49.786494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6fa3252d9f04964b481dd02b378d072'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:49.798661 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-705546fe-8657-467b-ab16-bb90368546d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6fa3252d9f04964b481dd02b378d072'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:49.811813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1226/2440] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:37:49 2022] DELETE /identity/v3/users/e6fa3252d9f04964b481dd02b378d072 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:49.980839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a828c-e59c-41da-9089-828d26a28c95 service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:49.992206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a828c-e59c-41da-9089-828d26a28c95 service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.048119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.048914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.049199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.049479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] PATH_INFO: `/v3/projects/a9501c41f0664eca9177e0071bb5b1b8` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.050919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9501c41f0664eca9177e0071bb5b1b8)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.052940 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.097451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9501c41f0664eca9177e0071bb5b1b8', 'request_id': 'req-b519190c-ab39-47df-a739-a5c61b7173ce'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:50.103377 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9501c41f0664eca9177e0071bb5b1b8', 'request_id': 'req-b519190c-ab39-47df-a739-a5c61b7173ce'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:50.109543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9501c41f0664eca9177e0071bb5b1b8', 'request_id': 'req-b519190c-ab39-47df-a739-a5c61b7173ce'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:50.121379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] The token cache is being invalidate because project a9501c41f0664eca9177e0071bb5b1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:37:50.121650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:50.122585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b519190c-ab39-47df-a739-a5c61b7173ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:37:50.124234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1215/2441] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:37:49 2022] DELETE /identity/v3/projects/a9501c41f0664eca9177e0071bb5b1b8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:50.129564 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459c871-ff2f-4f6b-9271-a1203bdaf3f9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.129931 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459c871-ff2f-4f6b-9271-a1203bdaf3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.130284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459c871-ff2f-4f6b-9271-a1203bdaf3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.151889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6459c871-ff2f-4f6b-9271-a1203bdaf3f9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:50.153113 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6459c871-ff2f-4f6b-9271-a1203bdaf3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:50.210195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1227/2442] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:50.217769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c218f0-2479-4ce3-884f-c6bff13571eb None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.218065 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c218f0-2479-4ce3-884f-c6bff13571eb None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.218961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c218f0-2479-4ce3-884f-c6bff13571eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.237346 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-20c218f0-2479-4ce3-884f-c6bff13571eb None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:50.238554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-20c218f0-2479-4ce3-884f-c6bff13571eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:50.246408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1216/2443] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:50.250788 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459c871-ff2f-4f6b-9271-a1203bdaf3f9 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:50.260374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459c871-ff2f-4f6b-9271-a1203bdaf3f9 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.264952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8525a61-c5cb-4811-a7ca-6306b26ccdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.265599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8525a61-c5cb-4811-a7ca-6306b26ccdbd admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.265885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8525a61-c5cb-4811-a7ca-6306b26ccdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.266162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8525a61-c5cb-4811-a7ca-6306b26ccdbd admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.266883 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8525a61-c5cb-4811-a7ca-6306b26ccdbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:37:50.267217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8525a61-c5cb-4811-a7ca-6306b26ccdbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.268813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8525a61-c5cb-4811-a7ca-6306b26ccdbd admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.280414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1228/2444] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:37:50.285166 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c218f0-2479-4ce3-884f-c6bff13571eb None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:50.294126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c218f0-2479-4ce3-884f-c6bff13571eb None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.299488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78e4eb-b15e-459e-8d27-23292e6e82c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.300056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78e4eb-b15e-459e-8d27-23292e6e82c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.300336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78e4eb-b15e-459e-8d27-23292e6e82c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.300611 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78e4eb-b15e-459e-8d27-23292e6e82c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.301335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78e4eb-b15e-459e-8d27-23292e6e82c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.303247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78e4eb-b15e-459e-8d27-23292e6e82c0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.339677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1217/2445] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:37:50 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:50.341403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8525a61-c5cb-4811-a7ca-6306b26ccdbd admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:50.352989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8525a61-c5cb-4811-a7ca-6306b26ccdbd admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.406795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2efc7-ce46-41c9-b470-043802388955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.407502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2efc7-ce46-41c9-b470-043802388955 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.407783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2efc7-ce46-41c9-b470-043802388955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.408059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2efc7-ce46-41c9-b470-043802388955 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.408782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2efc7-ce46-41c9-b470-043802388955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.410703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2efc7-ce46-41c9-b470-043802388955 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.430466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1229/2446] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:37:50 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:50.434632 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78e4eb-b15e-459e-8d27-23292e6e82c0 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:50.444766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78e4eb-b15e-459e-8d27-23292e6e82c0 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.449501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fef9e7-0804-48e8-a4e4-8408f2ffefa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.450156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef9e7-0804-48e8-a4e4-8408f2ffefa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.450443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef9e7-0804-48e8-a4e4-8408f2ffefa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.450723 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fef9e7-0804-48e8-a4e4-8408f2ffefa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.451493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fef9e7-0804-48e8-a4e4-8408f2ffefa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.453594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fef9e7-0804-48e8-a4e4-8408f2ffefa4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.463564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1218/2447] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:50.467376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2efc7-ce46-41c9-b470-043802388955 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:50.477831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2efc7-ce46-41c9-b470-043802388955 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.482416 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59c3bc-d4ac-4e69-b123-875669717722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.483082 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c3bc-d4ac-4e69-b123-875669717722 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.483367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c3bc-d4ac-4e69-b123-875669717722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.483641 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c3bc-d4ac-4e69-b123-875669717722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.484361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59c3bc-d4ac-4e69-b123-875669717722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.486327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59c3bc-d4ac-4e69-b123-875669717722 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.495849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1230/2448] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:50.500175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fef9e7-0804-48e8-a4e4-8408f2ffefa4 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:50.509897 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fef9e7-0804-48e8-a4e4-8408f2ffefa4 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.514491 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11dd25-24e4-44fe-a898-f91061302b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.515888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11dd25-24e4-44fe-a898-f91061302b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.516173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11dd25-24e4-44fe-a898-f91061302b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.516455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11dd25-24e4-44fe-a898-f91061302b52 admin admin] PATH_INFO: `/v3/projects/9462307fa603476baafa1c5c8ae491d5/users/e3a87d665be74a73ae84e15c39b735ad/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.531505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11dd25-24e4-44fe-a898-f91061302b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9462307fa603476baafa1c5c8ae491d5, user_id=e3a87d665be74a73ae84e15c39b735ad, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.534161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11dd25-24e4-44fe-a898-f91061302b52 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.546775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1219/2449] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:37:50 2022] PUT /identity/v3/projects/9462307fa603476baafa1c5c8ae491d5/users/e3a87d665be74a73ae84e15c39b735ad/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:50.552595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c639-115c-4f7b-bb13-731f617261c1 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.552832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c639-115c-4f7b-bb13-731f617261c1 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.553139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7c639-115c-4f7b-bb13-731f617261c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.570258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-42b7c639-115c-4f7b-bb13-731f617261c1 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:50.571500 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-42b7c639-115c-4f7b-bb13-731f617261c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:50.628042 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1231/2450] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:37:50.637514 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11dd25-24e4-44fe-a898-f91061302b52 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:50.639238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ca11dd25-24e4-44fe-a898-f91061302b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:50.696995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11dd25-24e4-44fe-a898-f91061302b52 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:50.700674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590351dc-d175-4a30-9c7a-34a23ddaa84b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:50.701321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590351dc-d175-4a30-9c7a-34a23ddaa84b service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:50.701608 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590351dc-d175-4a30-9c7a-34a23ddaa84b service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:50.701888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590351dc-d175-4a30-9c7a-34a23ddaa84b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:50.712062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590351dc-d175-4a30-9c7a-34a23ddaa84b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:50.713382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590351dc-d175-4a30-9c7a-34a23ddaa84b service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:50.722901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1220/2451] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:37:54.516260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6dca-8d0a-47d9-963b-ae70bed5ddaf None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.517136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6dca-8d0a-47d9-963b-ae70bed5ddaf None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.517136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be6dca-8d0a-47d9-963b-ae70bed5ddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.548114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-01be6dca-8d0a-47d9-963b-ae70bed5ddaf None None] MFA Rules not processed for user `e3a87d665be74a73ae84e15c39b735ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:54.549543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-01be6dca-8d0a-47d9-963b-ae70bed5ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:54.616177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1232/2452] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:37:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:54.620634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590351dc-d175-4a30-9c7a-34a23ddaa84b service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.631459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590351dc-d175-4a30-9c7a-34a23ddaa84b service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.636490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0152a75-a12d-4d9e-8a62-c61309aa48fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.637155 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0152a75-a12d-4d9e-8a62-c61309aa48fe admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.637438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0152a75-a12d-4d9e-8a62-c61309aa48fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.637713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0152a75-a12d-4d9e-8a62-c61309aa48fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.638412 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0152a75-a12d-4d9e-8a62-c61309aa48fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.640370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0152a75-a12d-4d9e-8a62-c61309aa48fe admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.668486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1221/2453] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:37:54 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:54.672909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be6dca-8d0a-47d9-963b-ae70bed5ddaf None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.684389 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be6dca-8d0a-47d9-963b-ae70bed5ddaf None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.742849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da8b2f-b257-43f4-9340-ad9a73a7fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.743592 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8b2f-b257-43f4-9340-ad9a73a7fca4 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.743881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8b2f-b257-43f4-9340-ad9a73a7fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.744157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da8b2f-b257-43f4-9340-ad9a73a7fca4 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.744864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da8b2f-b257-43f4-9340-ad9a73a7fca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.746819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da8b2f-b257-43f4-9340-ad9a73a7fca4 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.771618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1233/2454] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:37:54 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:37:54.773122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0152a75-a12d-4d9e-8a62-c61309aa48fe admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.785064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0152a75-a12d-4d9e-8a62-c61309aa48fe admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.789924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46365124-8b00-4205-87bf-6ef8c39ebfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.790600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46365124-8b00-4205-87bf-6ef8c39ebfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.790884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46365124-8b00-4205-87bf-6ef8c39ebfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.791206 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46365124-8b00-4205-87bf-6ef8c39ebfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.791941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46365124-8b00-4205-87bf-6ef8c39ebfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.793587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46365124-8b00-4205-87bf-6ef8c39ebfd4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.805926 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1222/2455] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:54.810236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da8b2f-b257-43f4-9340-ad9a73a7fca4 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.821196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da8b2f-b257-43f4-9340-ad9a73a7fca4 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.825915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5cad9-34d4-4f75-b7ff-d33eec0a4717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.826898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5cad9-34d4-4f75-b7ff-d33eec0a4717 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.827217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5cad9-34d4-4f75-b7ff-d33eec0a4717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.827577 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5cad9-34d4-4f75-b7ff-d33eec0a4717 admin admin] PATH_INFO: `/v3/projects/3e0c9753b3bd44e49e71379e14e32f56/users/e6bb17e076a04bb7b1e79d37bba7f432/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.843325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5cad9-34d4-4f75-b7ff-d33eec0a4717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0c9753b3bd44e49e71379e14e32f56, user_id=e6bb17e076a04bb7b1e79d37bba7f432, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.846779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5cad9-34d4-4f75-b7ff-d33eec0a4717 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.864168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1234/2456] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:37:54 2022] PUT /identity/v3/projects/3e0c9753b3bd44e49e71379e14e32f56/users/e6bb17e076a04bb7b1e79d37bba7f432/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:37:54.865326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46365124-8b00-4205-87bf-6ef8c39ebfd4 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.875891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46365124-8b00-4205-87bf-6ef8c39ebfd4 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.937443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ed9c3-0f5b-4c24-afeb-b780354bcbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.938127 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ed9c3-0f5b-4c24-afeb-b780354bcbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.938413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ed9c3-0f5b-4c24-afeb-b780354bcbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.938687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ed9c3-0f5b-4c24-afeb-b780354bcbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.939456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ed9c3-0f5b-4c24-afeb-b780354bcbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.941085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ed9c3-0f5b-4c24-afeb-b780354bcbe8 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.951631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1223/2457] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:37:54.956351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5cad9-34d4-4f75-b7ff-d33eec0a4717 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:54.968070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5cad9-34d4-4f75-b7ff-d33eec0a4717 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:54.973425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5646483-7d9a-448d-9b0d-f916e86a9518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:54.974295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5646483-7d9a-448d-9b0d-f916e86a9518 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:54.974572 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5646483-7d9a-448d-9b0d-f916e86a9518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:54.974839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5646483-7d9a-448d-9b0d-f916e86a9518 admin admin] PATH_INFO: `/v3/projects/3e0c9753b3bd44e49e71379e14e32f56/users/e6bb17e076a04bb7b1e79d37bba7f432/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:54.976863 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5646483-7d9a-448d-9b0d-f916e86a9518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0c9753b3bd44e49e71379e14e32f56, user_id=e6bb17e076a04bb7b1e79d37bba7f432, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:54.979536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5646483-7d9a-448d-9b0d-f916e86a9518 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:54.990427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1235/2458] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:37:54 2022] PUT /identity/v3/projects/3e0c9753b3bd44e49e71379e14e32f56/users/e6bb17e076a04bb7b1e79d37bba7f432/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:37:59.731901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe277-1e1d-4039-9fa2-fe197688b6ff None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:59.732416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe277-1e1d-4039-9fa2-fe197688b6ff None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:59.732530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6fe277-1e1d-4039-9fa2-fe197688b6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:59.765173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-ed6fe277-1e1d-4039-9fa2-fe197688b6ff None None] MFA Rules not processed for user `e6bb17e076a04bb7b1e79d37bba7f432`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:37:59.767367 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ed6fe277-1e1d-4039-9fa2-fe197688b6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:59.842659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1224/2459] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:37:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:37:59.855253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5646483-7d9a-448d-9b0d-f916e86a9518 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:37:59.857557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d5646483-7d9a-448d-9b0d-f916e86a9518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:37:59.919249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5646483-7d9a-448d-9b0d-f916e86a9518 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:37:59.922848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98108f4-5326-40ec-bce7-13e56013550e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10414e35df26406786eaf49c52661cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:37:59.923526 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98108f4-5326-40ec-bce7-13e56013550e service glance] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:37:59.923806 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98108f4-5326-40ec-bce7-13e56013550e service glance] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:37:59.924077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98108f4-5326-40ec-bce7-13e56013550e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:37:59.986795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98108f4-5326-40ec-bce7-13e56013550e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:37:59.988331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98108f4-5326-40ec-bce7-13e56013550e service glance] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:37:59.998020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1236/2460] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:37:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:00.098408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307c7e-7b96-4310-b4f7-9c3054ee4980 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:00.098772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307c7e-7b96-4310-b4f7-9c3054ee4980 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:00.098973 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307c7e-7b96-4310-b4f7-9c3054ee4980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:00.117291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-04307c7e-7b96-4310-b4f7-9c3054ee4980 None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:00.118505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-04307c7e-7b96-4310-b4f7-9c3054ee4980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:00.180330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1225/2461] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:38:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:00.193571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98108f4-5326-40ec-bce7-13e56013550e service glance] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:00.194949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d98108f4-5326-40ec-bce7-13e56013550e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:00.264374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98108f4-5326-40ec-bce7-13e56013550e service glance] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:00.269663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eda3a-71c7-46c8-8f51-b0951384a823 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:00.270311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eda3a-71c7-46c8-8f51-b0951384a823 service swift] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:00.270591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eda3a-71c7-46c8-8f51-b0951384a823 service swift] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:00.270864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eda3a-71c7-46c8-8f51-b0951384a823 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:00.279982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eda3a-71c7-46c8-8f51-b0951384a823 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:00.281828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eda3a-71c7-46c8-8f51-b0951384a823 service swift] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:00.289914 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1237/2462] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:38:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:38:02.237439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04307c7e-7b96-4310-b4f7-9c3054ee4980 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:02.239291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-04307c7e-7b96-4310-b4f7-9c3054ee4980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:02.328893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04307c7e-7b96-4310-b4f7-9c3054ee4980 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:02.337259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6219145-89ae-4394-8a74-a183c7cad9e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:02.337934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6219145-89ae-4394-8a74-a183c7cad9e8 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:02.338218 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6219145-89ae-4394-8a74-a183c7cad9e8 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:02.338497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6219145-89ae-4394-8a74-a183c7cad9e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:02.340495 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a6219145-89ae-4394-8a74-a183c7cad9e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:02.418118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6219145-89ae-4394-8a74-a183c7cad9e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:02.420216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6219145-89ae-4394-8a74-a183c7cad9e8 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:02.439885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1226/2463] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:38:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:10.330886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23e53-8229-463a-8f19-92b664a4af64 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.331618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23e53-8229-463a-8f19-92b664a4af64 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.332023 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23e53-8229-463a-8f19-92b664a4af64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.367736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e7e23e53-8229-463a-8f19-92b664a4af64 None None] MFA Rules not processed for user `e3a87d665be74a73ae84e15c39b735ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:10.369909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e7e23e53-8229-463a-8f19-92b664a4af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:10.379008 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1238/2464] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:38:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:10.818792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dfe48-ef02-4b74-bd03-0050a7b82759 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:10.820309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dfe48-ef02-4b74-bd03-0050a7b82759 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:10.821071 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0dfe48-ef02-4b74-bd03-0050a7b82759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:10.839581 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-ba0dfe48-ef02-4b74-bd03-0050a7b82759 None None] MFA Rules not processed for user `a64c3ea69151401897e4203095676543`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:10.841353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ba0dfe48-ef02-4b74-bd03-0050a7b82759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:10.903543 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1227/2465] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:38:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:11.071422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e23e53-8229-463a-8f19-92b664a4af64 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:11.127874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e23e53-8229-463a-8f19-92b664a4af64 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:11.133688 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271d0b1-b0ff-4703-9b58-543f96596377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:11.134362 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d0b1-b0ff-4703-9b58-543f96596377 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:11.134643 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d0b1-b0ff-4703-9b58-543f96596377 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:11.134915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d0b1-b0ff-4703-9b58-543f96596377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:11.141178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3271d0b1-b0ff-4703-9b58-543f96596377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:11.153891 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271d0b1-b0ff-4703-9b58-543f96596377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:11.158444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271d0b1-b0ff-4703-9b58-543f96596377 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:11.170278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1239/2466] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:38:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:11.478553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0dfe48-ef02-4b74-bd03-0050a7b82759 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:11.487921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0dfe48-ef02-4b74-bd03-0050a7b82759 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:11.491484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771b1ea-3df5-4d18-8032-2c83ce12ede1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:11.492126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771b1ea-3df5-4d18-8032-2c83ce12ede1 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:11.492407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771b1ea-3df5-4d18-8032-2c83ce12ede1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:11.492680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771b1ea-3df5-4d18-8032-2c83ce12ede1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:11.494626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2771b1ea-3df5-4d18-8032-2c83ce12ede1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:11.504651 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771b1ea-3df5-4d18-8032-2c83ce12ede1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:11.506075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771b1ea-3df5-4d18-8032-2c83ce12ede1 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:11.514514 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1228/2467] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:38:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:11.622123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271d0b1-b0ff-4703-9b58-543f96596377 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:11.623693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-3271d0b1-b0ff-4703-9b58-543f96596377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:11.715920 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271d0b1-b0ff-4703-9b58-543f96596377 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:11.721480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53259f2-a333-44f3-b1c4-9b1bb2d3c590 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3004f3e4a9854502be59119e17e04961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:11.722126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53259f2-a333-44f3-b1c4-9b1bb2d3c590 service placement] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:11.722406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53259f2-a333-44f3-b1c4-9b1bb2d3c590 service placement] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:11.722677 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53259f2-a333-44f3-b1c4-9b1bb2d3c590 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:11.724921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a53259f2-a333-44f3-b1c4-9b1bb2d3c590 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:11.737287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53259f2-a333-44f3-b1c4-9b1bb2d3c590 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:11.739213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53259f2-a333-44f3-b1c4-9b1bb2d3c590 service placement] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:11.753302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1240/2468] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:38:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:13.826433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236593a9-56f4-42d7-8316-65c309ca3c0e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:13.826914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236593a9-56f4-42d7-8316-65c309ca3c0e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:13.828364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236593a9-56f4-42d7-8316-65c309ca3c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:13.847902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-236593a9-56f4-42d7-8316-65c309ca3c0e None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:13.849205 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-236593a9-56f4-42d7-8316-65c309ca3c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:13.857705 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1229/2469] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:13.870723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53259f2-a333-44f3-b1c4-9b1bb2d3c590 service placement] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:13.882878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53259f2-a333-44f3-b1c4-9b1bb2d3c590 service placement] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:13.887880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363222c7-fcf8-41a7-b763-3e4ae23124d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:13.888510 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363222c7-fcf8-41a7-b763-3e4ae23124d2 service swift] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:13.888791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363222c7-fcf8-41a7-b763-3e4ae23124d2 service swift] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:13.889186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363222c7-fcf8-41a7-b763-3e4ae23124d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:13.897909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363222c7-fcf8-41a7-b763-3e4ae23124d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:13.899548 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363222c7-fcf8-41a7-b763-3e4ae23124d2 service swift] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:13.908587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1241/2470] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:38:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:38:16.644701 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236593a9-56f4-42d7-8316-65c309ca3c0e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:16.658132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236593a9-56f4-42d7-8316-65c309ca3c0e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:16.663445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7c9a5-5619-4403-bc6c-20271ecc16f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:16.664087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c9a5-5619-4403-bc6c-20271ecc16f4 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:16.664372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c9a5-5619-4403-bc6c-20271ecc16f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:16.664651 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7c9a5-5619-4403-bc6c-20271ecc16f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:16.666407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f5b7c9a5-5619-4403-bc6c-20271ecc16f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:16.676546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7c9a5-5619-4403-bc6c-20271ecc16f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:16.678111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7c9a5-5619-4403-bc6c-20271ecc16f4 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:16.692457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1230/2471] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:38:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:40.678869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363222c7-fcf8-41a7-b763-3e4ae23124d2 service swift] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:40.691908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363222c7-fcf8-41a7-b763-3e4ae23124d2 service swift] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:40.697384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5156b4-e593-45db-b36f-684cb5064c1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:40.698017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5156b4-e593-45db-b36f-684cb5064c1c service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:40.698300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5156b4-e593-45db-b36f-684cb5064c1c service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:40.698574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5156b4-e593-45db-b36f-684cb5064c1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:40.700489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8d5156b4-e593-45db-b36f-684cb5064c1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:40.713165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5156b4-e593-45db-b36f-684cb5064c1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:40.714766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5156b4-e593-45db-b36f-684cb5064c1c service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:40.725626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1242/2472] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:38:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:41.360474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc1f6e-894f-4ad4-85d5-4af2b9fd10b5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:41.360992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc1f6e-894f-4ad4-85d5-4af2b9fd10b5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:41.361234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc1f6e-894f-4ad4-85d5-4af2b9fd10b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:41.378931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-e6bc1f6e-894f-4ad4-85d5-4af2b9fd10b5 None None] MFA Rules not processed for user `c6422873a3b84aac88f8a93291bcd7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:41.380185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e6bc1f6e-894f-4ad4-85d5-4af2b9fd10b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:41.386999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1231/2473] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:38:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:38:42.049513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5156b4-e593-45db-b36f-684cb5064c1c service nova] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:38:42.074183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5156b4-e593-45db-b36f-684cb5064c1c service nova] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:38:42.081176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47705da-afe1-416b-9ab9-92cb19d5c54d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:38:42.082341 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47705da-afe1-416b-9ab9-92cb19d5c54d service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:42.082658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47705da-afe1-416b-9ab9-92cb19d5c54d service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:42.082939 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47705da-afe1-416b-9ab9-92cb19d5c54d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:42.084824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f47705da-afe1-416b-9ab9-92cb19d5c54d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:42.160234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47705da-afe1-416b-9ab9-92cb19d5c54d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:38:42.162028 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47705da-afe1-416b-9ab9-92cb19d5c54d service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:38:42.172509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1243/2474] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:38:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:38:48.295018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d51ed-6624-4fbb-9536-0546497e6d57 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:38:48.295562 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d51ed-6624-4fbb-9536-0546497e6d57 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:38:48.295681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d51ed-6624-4fbb-9536-0546497e6d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:38:48.313550 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-703d51ed-6624-4fbb-9536-0546497e6d57 None None] MFA Rules not processed for user `c3b76edcb338405a9bf2f68e91dfacdd`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:38:48.314747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-703d51ed-6624-4fbb-9536-0546497e6d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:38:48.367825 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1232/2475] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:38:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:04.093193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47705da-afe1-416b-9ab9-92cb19d5c54d service nova] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:04.102411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47705da-afe1-416b-9ab9-92cb19d5c54d service nova] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:04.106021 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fded8-1ae6-4aa5-a45b-ee45de1bb180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:04.106656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fded8-1ae6-4aa5-a45b-ee45de1bb180 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:04.107323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fded8-1ae6-4aa5-a45b-ee45de1bb180 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:04.107323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fded8-1ae6-4aa5-a45b-ee45de1bb180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:04.116173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fded8-1ae6-4aa5-a45b-ee45de1bb180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:04.117596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fded8-1ae6-4aa5-a45b-ee45de1bb180 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:04.127088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1244/2476] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:39:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:09.893528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d51ed-6624-4fbb-9536-0546497e6d57 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:09.894995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-703d51ed-6624-4fbb-9536-0546497e6d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:09.911386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d51ed-6624-4fbb-9536-0546497e6d57 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:09.917085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5c64-5206-4e54-b848-bd1b9b5978bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:09.917734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5c64-5206-4e54-b848-bd1b9b5978bb service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:09.918048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5c64-5206-4e54-b848-bd1b9b5978bb service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:09.918329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77b5c64-5206-4e54-b848-bd1b9b5978bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:09.920663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d77b5c64-5206-4e54-b848-bd1b9b5978bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:09.932757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b5c64-5206-4e54-b848-bd1b9b5978bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:09.934409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77b5c64-5206-4e54-b848-bd1b9b5978bb service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:09.946062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1233/2477] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:39:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:15.625723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057786-0aa2-4dd7-9f86-f182a6fb3404 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:15.626261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057786-0aa2-4dd7-9f86-f182a6fb3404 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:15.626261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4057786-0aa2-4dd7-9f86-f182a6fb3404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:15.643019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e4057786-0aa2-4dd7-9f86-f182a6fb3404 None None] MFA Rules not processed for user `2cfa47f1da4e4ae9a358e2b8ace795ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:15.644247 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e4057786-0aa2-4dd7-9f86-f182a6fb3404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:15.651159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1245/2478] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:32.055877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5c64-5206-4e54-b848-bd1b9b5978bb service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:32.067612 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77b5c64-5206-4e54-b848-bd1b9b5978bb service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:32.074885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495ebe-4262-46f2-99f8-d32a9b546be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:32.075573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495ebe-4262-46f2-99f8-d32a9b546be7 service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:32.075858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495ebe-4262-46f2-99f8-d32a9b546be7 service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:32.076138 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495ebe-4262-46f2-99f8-d32a9b546be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:32.077968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f7495ebe-4262-46f2-99f8-d32a9b546be7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:32.134996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495ebe-4262-46f2-99f8-d32a9b546be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:32.137258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495ebe-4262-46f2-99f8-d32a9b546be7 service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:32.146521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1234/2479] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:39:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:35.986999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7608c4e-6b03-4dbc-b2e6-68c4502a477f None None] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:35.987598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7608c4e-6b03-4dbc-b2e6-68c4502a477f None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:35.987598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7608c4e-6b03-4dbc-b2e6-68c4502a477f None None] PATH_INFO: `/` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:35.988951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1246/2480] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 12 14:39:35.995438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187049b-93cf-4b98-9fff-e47f3703dbe8 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:35.996388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187049b-93cf-4b98-9fff-e47f3703dbe8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:35.996669 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187049b-93cf-4b98-9fff-e47f3703dbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:36.015178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-0187049b-93cf-4b98-9fff-e47f3703dbe8 None None] MFA Rules not processed for user `5aca248c2e074fc4baff39930e21fe29`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:36.016407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0187049b-93cf-4b98-9fff-e47f3703dbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:36.023229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1235/2481] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:39:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:36.035083 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7608c4e-6b03-4dbc-b2e6-68c4502a477f None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:36.036972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b7608c4e-6b03-4dbc-b2e6-68c4502a477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:36.050603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7608c4e-6b03-4dbc-b2e6-68c4502a477f None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:36.054349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b544cd7-95dc-4d35-b21b-bfb4c0a75c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:36.054984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544cd7-95dc-4d35-b21b-bfb4c0a75c8f service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:36.055311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544cd7-95dc-4d35-b21b-bfb4c0a75c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:36.055589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b544cd7-95dc-4d35-b21b-bfb4c0a75c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:36.063435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b544cd7-95dc-4d35-b21b-bfb4c0a75c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:36.064876 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b544cd7-95dc-4d35-b21b-bfb4c0a75c8f service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:36.072639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1247/2482] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:39:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:39:36.153083 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0befa-4982-48fb-9770-f0ae247b2f30 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:36.153397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0befa-4982-48fb-9770-f0ae247b2f30 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:36.153672 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0befa-4982-48fb-9770-f0ae247b2f30 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:36.155098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1236/2483] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:39:36.160419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da8c5c-e8ac-4a47-a64d-03ea898b7b97 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:36.160721 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da8c5c-e8ac-4a47-a64d-03ea898b7b97 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:36.161002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da8c5c-e8ac-4a47-a64d-03ea898b7b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:36.179612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e9da8c5c-e8ac-4a47-a64d-03ea898b7b97 None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:39:36.180826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e9da8c5c-e8ac-4a47-a64d-03ea898b7b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:39:36.190778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1248/2484] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:39:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:39:36.200936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0befa-4982-48fb-9770-f0ae247b2f30 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:39:36.211903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0befa-4982-48fb-9770-f0ae247b2f30 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:39:36.215601 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16144fab-bf42-477b-95c0-c7fd042f0d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:39:36.216178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16144fab-bf42-477b-95c0-c7fd042f0d7d service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:39:36.216461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16144fab-bf42-477b-95c0-c7fd042f0d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:39:36.216738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16144fab-bf42-477b-95c0-c7fd042f0d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:39:36.226692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16144fab-bf42-477b-95c0-c7fd042f0d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:39:36.228161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16144fab-bf42-477b-95c0-c7fd042f0d7d service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:39:36.239209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1237/2485] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:39:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:40:22.068357 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da8c5c-e8ac-4a47-a64d-03ea898b7b97 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:40:22.069711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e9da8c5c-e8ac-4a47-a64d-03ea898b7b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:22.084248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da8c5c-e8ac-4a47-a64d-03ea898b7b97 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:40:22.089191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0616a-dbd8-4835-ba0d-686c34414a4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3004f3e4a9854502be59119e17e04961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:40:22.089839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0616a-dbd8-4835-ba0d-686c34414a4d service placement] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:40:22.090133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0616a-dbd8-4835-ba0d-686c34414a4d service placement] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:40:22.090407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0616a-dbd8-4835-ba0d-686c34414a4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:40:22.092220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d7e0616a-dbd8-4835-ba0d-686c34414a4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:40:22.103866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0616a-dbd8-4835-ba0d-686c34414a4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:40:22.105449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0616a-dbd8-4835-ba0d-686c34414a4d service placement] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:40:22.115123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1249/2486] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:40:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:02.706826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e91af-a549-4c88-974b-952e390526f8 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:02.707469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e91af-a549-4c88-974b-952e390526f8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:02.707469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e91af-a549-4c88-974b-952e390526f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:02.725752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-8c7e91af-a549-4c88-974b-952e390526f8 None None] MFA Rules not processed for user `c6422873a3b84aac88f8a93291bcd7b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:02.726964 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8c7e91af-a549-4c88-974b-952e390526f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:02.734612 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1238/2487] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:41:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:04.864434 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0616a-dbd8-4835-ba0d-686c34414a4d service placement] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:04.874680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0616a-dbd8-4835-ba0d-686c34414a4d service placement] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:04.878996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ed96f-35d9-4d35-a2a3-f9aef473b012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:04.879544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed96f-35d9-4d35-a2a3-f9aef473b012 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:04.879863 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed96f-35d9-4d35-a2a3-f9aef473b012 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:04.880136 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ed96f-35d9-4d35-a2a3-f9aef473b012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:04.881952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b39ed96f-35d9-4d35-a2a3-f9aef473b012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:04.954054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ed96f-35d9-4d35-a2a3-f9aef473b012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:04.955888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ed96f-35d9-4d35-a2a3-f9aef473b012 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:04.967244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1250/2488] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:06.579784 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bbd38-01cf-476e-82cc-38e258c6a16e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:06.580256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bbd38-01cf-476e-82cc-38e258c6a16e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:06.580347 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bbd38-01cf-476e-82cc-38e258c6a16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:06.613666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-815bbd38-01cf-476e-82cc-38e258c6a16e None None] MFA Rules not processed for user `a64c3ea69151401897e4203095676543`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:06.614900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-815bbd38-01cf-476e-82cc-38e258c6a16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:06.622416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1239/2489] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:41:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:09.467772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ed96f-35d9-4d35-a2a3-f9aef473b012 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:09.469220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b39ed96f-35d9-4d35-a2a3-f9aef473b012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:09.480832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ed96f-35d9-4d35-a2a3-f9aef473b012 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:09.485439 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:09.486302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:09.486779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:09.487417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] PATH_INFO: `/v3/users/2cfa47f1da4e4ae9a358e2b8ace795ac` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:09.488854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cfa47f1da4e4ae9a358e2b8ace795ac)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:09.490834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:09.545421 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cfa47f1da4e4ae9a358e2b8ace795ac'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:09.551893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cfa47f1da4e4ae9a358e2b8ace795ac'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:09.552552 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cfa47f1da4e4ae9a358e2b8ace795ac'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:09.553165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cfa47f1da4e4ae9a358e2b8ace795ac'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:09.564926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-4fa87a0b-b86d-4554-98d7-6cf4a0eac232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cfa47f1da4e4ae9a358e2b8ace795ac'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:09.577653 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1251/2490] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:41:09 2022] DELETE /identity/v3/users/2cfa47f1da4e4ae9a358e2b8ace795ac => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:41:09.742703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bbd38-01cf-476e-82cc-38e258c6a16e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:09.755247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bbd38-01cf-476e-82cc-38e258c6a16e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:09.817028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:09.817921 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:09.818214 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:09.818510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] PATH_INFO: `/v3/projects/3c83c8fa2cd44eab84cb50b3ad06a1d3` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:09.820392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c83c8fa2cd44eab84cb50b3ad06a1d3)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:09.822373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:09.878623 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'request_id': 'req-ada29d15-b447-491e-a3ed-f8328d6bfef3'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:09.885439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'request_id': 'req-ada29d15-b447-491e-a3ed-f8328d6bfef3'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:09.891788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c83c8fa2cd44eab84cb50b3ad06a1d3', 'request_id': 'req-ada29d15-b447-491e-a3ed-f8328d6bfef3'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:09.906750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] The token cache is being invalidate because project 3c83c8fa2cd44eab84cb50b3ad06a1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:41:09.907047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:09.908246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ada29d15-b447-491e-a3ed-f8328d6bfef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:09.910058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1240/2491] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:41:09 2022] DELETE /identity/v3/projects/3c83c8fa2cd44eab84cb50b3ad06a1d3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:41:09.915093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00fb97-5557-4249-b5c3-5af0b59a76a9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:09.915652 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00fb97-5557-4249-b5c3-5af0b59a76a9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:09.915935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00fb97-5557-4249-b5c3-5af0b59a76a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:09.934237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-5e00fb97-5557-4249-b5c3-5af0b59a76a9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:09.940318 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5e00fb97-5557-4249-b5c3-5af0b59a76a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:10.002275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1252/2492] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:10.010567 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2cb99-1b94-4ab3-9a4d-5476e1ac3edb None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:10.010859 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2cb99-1b94-4ab3-9a4d-5476e1ac3edb None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:10.011169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2cb99-1b94-4ab3-9a4d-5476e1ac3edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:10.030465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-82b2cb99-1b94-4ab3-9a4d-5476e1ac3edb None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:10.031759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-82b2cb99-1b94-4ab3-9a4d-5476e1ac3edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:10.039662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1241/2493] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:10.043776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00fb97-5557-4249-b5c3-5af0b59a76a9 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:10.053052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00fb97-5557-4249-b5c3-5af0b59a76a9 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:10.057540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf58e-fe3e-476c-9f2f-98dbc60d4f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:10.058177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf58e-fe3e-476c-9f2f-98dbc60d4f06 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:10.058474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf58e-fe3e-476c-9f2f-98dbc60d4f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:10.058768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cf58e-fe3e-476c-9f2f-98dbc60d4f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:10.059525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cf58e-fe3e-476c-9f2f-98dbc60d4f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:41:10.059827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cf58e-fe3e-476c-9f2f-98dbc60d4f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:10.061406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cf58e-fe3e-476c-9f2f-98dbc60d4f06 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:10.072264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1253/2494] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:41:10.076805 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2cb99-1b94-4ab3-9a4d-5476e1ac3edb None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:10.085774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2cb99-1b94-4ab3-9a4d-5476e1ac3edb None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:10.091051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44fcef-1760-4ecb-89be-b555d4aaa898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:10.091708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44fcef-1760-4ecb-89be-b555d4aaa898 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:10.091993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44fcef-1760-4ecb-89be-b555d4aaa898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:10.092298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44fcef-1760-4ecb-89be-b555d4aaa898 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:10.092984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44fcef-1760-4ecb-89be-b555d4aaa898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:10.094891 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44fcef-1760-4ecb-89be-b555d4aaa898 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:10.119337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1242/2495] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:41:10 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:41:10.123964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf58e-fe3e-476c-9f2f-98dbc60d4f06 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:10.133668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cf58e-fe3e-476c-9f2f-98dbc60d4f06 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:10.187753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfba80-696d-4084-b584-7a13a03cafee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:10.188343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfba80-696d-4084-b584-7a13a03cafee admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:10.188624 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfba80-696d-4084-b584-7a13a03cafee admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:10.188926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfba80-696d-4084-b584-7a13a03cafee admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:10.189713 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfba80-696d-4084-b584-7a13a03cafee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:10.191734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfba80-696d-4084-b584-7a13a03cafee admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:10.216622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1254/2496] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:41:10 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:41:10.217859 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44fcef-1760-4ecb-89be-b555d4aaa898 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:10.228414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44fcef-1760-4ecb-89be-b555d4aaa898 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:10.233341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a2b44-a44e-44c5-9a7a-d6d802d1f4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:10.234018 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a2b44-a44e-44c5-9a7a-d6d802d1f4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:10.234306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a2b44-a44e-44c5-9a7a-d6d802d1f4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:10.234588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a2b44-a44e-44c5-9a7a-d6d802d1f4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:10.235356 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a2b44-a44e-44c5-9a7a-d6d802d1f4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:10.236968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a2b44-a44e-44c5-9a7a-d6d802d1f4a6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:10.248259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1243/2497] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:41:10.252288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfba80-696d-4084-b584-7a13a03cafee admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:10.262690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfba80-696d-4084-b584-7a13a03cafee admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:10.267344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a1e56-8fe1-4d83-ac38-d945fa7314df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:10.267997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a1e56-8fe1-4d83-ac38-d945fa7314df admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:10.268275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a1e56-8fe1-4d83-ac38-d945fa7314df admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:10.268600 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a1e56-8fe1-4d83-ac38-d945fa7314df admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:10.269327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a1e56-8fe1-4d83-ac38-d945fa7314df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:10.271078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a1e56-8fe1-4d83-ac38-d945fa7314df admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:10.284308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1255/2498] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:41:10.285483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a2b44-a44e-44c5-9a7a-d6d802d1f4a6 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:10.295423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a2b44-a44e-44c5-9a7a-d6d802d1f4a6 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:10.300130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3021a95-de9b-466e-a0bc-02d26abc7f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:10.301090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021a95-de9b-466e-a0bc-02d26abc7f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:10.301448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021a95-de9b-466e-a0bc-02d26abc7f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:10.301798 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021a95-de9b-466e-a0bc-02d26abc7f95 admin admin] PATH_INFO: `/v3/projects/38fdbe6cacb8487087950884b752b21d/users/5ea3990cf736495ea612f1f5ed4f8674/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:10.318621 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3021a95-de9b-466e-a0bc-02d26abc7f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38fdbe6cacb8487087950884b752b21d, user_id=5ea3990cf736495ea612f1f5ed4f8674, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:10.321396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3021a95-de9b-466e-a0bc-02d26abc7f95 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:10.344130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1244/2499] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:41:10 2022] PUT /identity/v3/projects/38fdbe6cacb8487087950884b752b21d/users/5ea3990cf736495ea612f1f5ed4f8674/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:41:10.349253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fe1ef-4dbc-4b69-86a0-3b0344db78c3 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:10.349545 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fe1ef-4dbc-4b69-86a0-3b0344db78c3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:10.349826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fe1ef-4dbc-4b69-86a0-3b0344db78c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:10.367264 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a03fe1ef-4dbc-4b69-86a0-3b0344db78c3 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:10.368743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a03fe1ef-4dbc-4b69-86a0-3b0344db78c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:10.424332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1256/2500] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:10.434244 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3021a95-de9b-466e-a0bc-02d26abc7f95 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:10.435959 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b3021a95-de9b-466e-a0bc-02d26abc7f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:10.490925 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3021a95-de9b-466e-a0bc-02d26abc7f95 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:10.494898 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e1c30-f209-4ec9-9190-742edfb86bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:10.495568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e1c30-f209-4ec9-9190-742edfb86bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:10.495856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e1c30-f209-4ec9-9190-742edfb86bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:10.496142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e1c30-f209-4ec9-9190-742edfb86bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:10.505510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e1c30-f209-4ec9-9190-742edfb86bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:10.506989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e1c30-f209-4ec9-9190-742edfb86bd1 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:10.516343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1245/2501] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:16.538235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8002-5d43-4a42-808d-a48b20a556aa None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:16.538722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8002-5d43-4a42-808d-a48b20a556aa None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:16.538814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc8002-5d43-4a42-808d-a48b20a556aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:16.568903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-30dc8002-5d43-4a42-808d-a48b20a556aa None None] MFA Rules not processed for user `5ea3990cf736495ea612f1f5ed4f8674`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:16.570157 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-30dc8002-5d43-4a42-808d-a48b20a556aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:16.639407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1257/2502] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:16.653762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e1c30-f209-4ec9-9190-742edfb86bd1 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:16.655252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b97e1c30-f209-4ec9-9190-742edfb86bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:16.728466 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e1c30-f209-4ec9-9190-742edfb86bd1 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:16.734518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5869c21-5445-41fc-badb-6fd9b96bb38a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:16.735054 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5869c21-5445-41fc-badb-6fd9b96bb38a service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:16.735339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5869c21-5445-41fc-badb-6fd9b96bb38a service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:16.735617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5869c21-5445-41fc-badb-6fd9b96bb38a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:16.744293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5869c21-5445-41fc-badb-6fd9b96bb38a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:16.745880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5869c21-5445-41fc-badb-6fd9b96bb38a service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:16.755136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1246/2503] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:16.883442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc8002-5d43-4a42-808d-a48b20a556aa None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:16.894311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc8002-5d43-4a42-808d-a48b20a556aa None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:16.897942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62426-b7cd-49e5-a1ed-fc573eeaf2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:16.898592 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62426-b7cd-49e5-a1ed-fc573eeaf2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:16.898875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62426-b7cd-49e5-a1ed-fc573eeaf2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:16.899352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62426-b7cd-49e5-a1ed-fc573eeaf2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:16.901159 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-81d62426-b7cd-49e5-a1ed-fc573eeaf2f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:16.936644 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d62426-b7cd-49e5-a1ed-fc573eeaf2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:16.938374 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d62426-b7cd-49e5-a1ed-fc573eeaf2f5 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:16.951645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1258/2504] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:17.550139 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5869c21-5445-41fc-badb-6fd9b96bb38a service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:17.560563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5869c21-5445-41fc-badb-6fd9b96bb38a service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:17.564628 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde822ef-4282-4480-9188-99a0fc4a9caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:17.565525 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde822ef-4282-4480-9188-99a0fc4a9caf service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:17.566014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde822ef-4282-4480-9188-99a0fc4a9caf service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:17.566290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde822ef-4282-4480-9188-99a0fc4a9caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:17.568202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cde822ef-4282-4480-9188-99a0fc4a9caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:17.586338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde822ef-4282-4480-9188-99a0fc4a9caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:17.588894 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde822ef-4282-4480-9188-99a0fc4a9caf service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:17.606215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1247/2505] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:18.121171 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296b3e-126a-4bc6-8cc2-54de3ebfbc3a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:18.123296 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296b3e-126a-4bc6-8cc2-54de3ebfbc3a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:18.123612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c296b3e-126a-4bc6-8cc2-54de3ebfbc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:18.154234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-1c296b3e-126a-4bc6-8cc2-54de3ebfbc3a None None] MFA Rules not processed for user `5ea3990cf736495ea612f1f5ed4f8674`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:18.156130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1c296b3e-126a-4bc6-8cc2-54de3ebfbc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:18.168096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1259/2506] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:41:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:27.731804 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde822ef-4282-4480-9188-99a0fc4a9caf service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:27.733228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cde822ef-4282-4480-9188-99a0fc4a9caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:27.747212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde822ef-4282-4480-9188-99a0fc4a9caf service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:27.752740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acae54-17b0-4a0e-b62c-1b38379f763b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:27.753369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acae54-17b0-4a0e-b62c-1b38379f763b service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:27.753648 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acae54-17b0-4a0e-b62c-1b38379f763b service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:27.753920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acae54-17b0-4a0e-b62c-1b38379f763b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:27.755699 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a9acae54-17b0-4a0e-b62c-1b38379f763b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:27.840602 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acae54-17b0-4a0e-b62c-1b38379f763b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:27.842265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acae54-17b0-4a0e-b62c-1b38379f763b service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:27.861147 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1248/2507] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:29.188454 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8988-323f-4fc6-80f2-dc54b4666e5d None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:29.188928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8988-323f-4fc6-80f2-dc54b4666e5d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:29.189048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd8988-323f-4fc6-80f2-dc54b4666e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:29.207856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-abfd8988-323f-4fc6-80f2-dc54b4666e5d None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:29.209085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-abfd8988-323f-4fc6-80f2-dc54b4666e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:29.268331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1260/2508] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:41:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:29.309660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acae54-17b0-4a0e-b62c-1b38379f763b service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:29.311239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a9acae54-17b0-4a0e-b62c-1b38379f763b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:29.379246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acae54-17b0-4a0e-b62c-1b38379f763b service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:29.384876 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c87f-beaa-4d20-a0b2-19ddfe593023 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:29.385462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c87f-beaa-4d20-a0b2-19ddfe593023 service swift] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:29.385746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c87f-beaa-4d20-a0b2-19ddfe593023 service swift] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:29.386024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596c87f-beaa-4d20-a0b2-19ddfe593023 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:29.394707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596c87f-beaa-4d20-a0b2-19ddfe593023 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:29.396443 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596c87f-beaa-4d20-a0b2-19ddfe593023 service swift] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:29.405909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1249/2509] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:41:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 14:41:32.023507 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd8988-323f-4fc6-80f2-dc54b4666e5d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:32.034220 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd8988-323f-4fc6-80f2-dc54b4666e5d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:32.038127 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3dbf4-19dc-4131-8d07-ad6fb9e24a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:32.039060 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3dbf4-19dc-4131-8d07-ad6fb9e24a37 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:32.039515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3dbf4-19dc-4131-8d07-ad6fb9e24a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:32.039954 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3dbf4-19dc-4131-8d07-ad6fb9e24a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:32.043021 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c9d3dbf4-19dc-4131-8d07-ad6fb9e24a37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:32.112804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3dbf4-19dc-4131-8d07-ad6fb9e24a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:32.114224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3dbf4-19dc-4131-8d07-ad6fb9e24a37 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:32.127692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1261/2510] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:43.927451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c87f-beaa-4d20-a0b2-19ddfe593023 service swift] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:43.930524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3dbf4-19dc-4131-8d07-ad6fb9e24a37 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:43.939292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596c87f-beaa-4d20-a0b2-19ddfe593023 service swift] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:43.939844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3dbf4-19dc-4131-8d07-ad6fb9e24a37 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:43.943645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f32c6d-6889-4e60-b2d8-967c7c78e198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:43.944436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32c6d-6889-4e60-b2d8-967c7c78e198 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:43.944736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32c6d-6889-4e60-b2d8-967c7c78e198 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:43.945074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32c6d-6889-4e60-b2d8-967c7c78e198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:43.945835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4220e9e9-1e5a-4eec-84c3-11bfced7dce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:43.946598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220e9e9-1e5a-4eec-84c3-11bfced7dce6 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:43.947157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220e9e9-1e5a-4eec-84c3-11bfced7dce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:43.947463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d7f32c6d-6889-4e60-b2d8-967c7c78e198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:43.947640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4220e9e9-1e5a-4eec-84c3-11bfced7dce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:43.949577 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4220e9e9-1e5a-4eec-84c3-11bfced7dce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:43.957778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f32c6d-6889-4e60-b2d8-967c7c78e198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:43.959236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f32c6d-6889-4e60-b2d8-967c7c78e198 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:43.963332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220e9e9-1e5a-4eec-84c3-11bfced7dce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:43.963332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4220e9e9-1e5a-4eec-84c3-11bfced7dce6 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:43.970738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1250/2511] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:43.971180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1262/2512] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:41:49.055821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d2846-04cc-48f4-974b-ae5dce0f5d96 None None] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:49.056414 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d2846-04cc-48f4-974b-ae5dce0f5d96 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:49.056528 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d2846-04cc-48f4-974b-ae5dce0f5d96 None None] PATH_INFO: `/` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:49.057963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1251/2513] 10.222.0.75 () {54 vars in 921 bytes} [Thu May 12 14:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 12 14:41:49.064910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78fbdd-aa6e-48f9-a95f-e74a0470bd15 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:49.065378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78fbdd-aa6e-48f9-a95f-e74a0470bd15 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:49.065475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78fbdd-aa6e-48f9-a95f-e74a0470bd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:49.083717 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-1e78fbdd-aa6e-48f9-a95f-e74a0470bd15 None None] MFA Rules not processed for user `2366609a0a564e7fbcb05b503de78580`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:49.084534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1e78fbdd-aa6e-48f9-a95f-e74a0470bd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:49.094385 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1263/2514] 10.222.0.75 () {58 vars in 1018 bytes} [Thu May 12 14:41:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:49.106693 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d2846-04cc-48f4-974b-ae5dce0f5d96 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:49.108494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c25d2846-04cc-48f4-974b-ae5dce0f5d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:49.168775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d2846-04cc-48f4-974b-ae5dce0f5d96 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:49.172568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7a797-9752-4914-a0f4-dde82c760b0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10414e35df26406786eaf49c52661cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:49.173301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7a797-9752-4914-a0f4-dde82c760b0d service glance] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:49.173585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7a797-9752-4914-a0f4-dde82c760b0d service glance] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:49.173866 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7a797-9752-4914-a0f4-dde82c760b0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:49.186515 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7a797-9752-4914-a0f4-dde82c760b0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:49.188399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7a797-9752-4914-a0f4-dde82c760b0d service glance] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:49.203317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1252/2515] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:41:49.600016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78fbdd-aa6e-48f9-a95f-e74a0470bd15 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:49.609593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78fbdd-aa6e-48f9-a95f-e74a0470bd15 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:49.613633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aec53c-b449-4e8f-9bf7-eb6d20da355b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:49.614189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec53c-b449-4e8f-9bf7-eb6d20da355b service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:49.614474 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec53c-b449-4e8f-9bf7-eb6d20da355b service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:49.614750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aec53c-b449-4e8f-9bf7-eb6d20da355b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:49.616860 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e3aec53c-b449-4e8f-9bf7-eb6d20da355b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:49.631856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aec53c-b449-4e8f-9bf7-eb6d20da355b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:49.633313 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aec53c-b449-4e8f-9bf7-eb6d20da355b service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:49.643483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1264/2516] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:41:51.905316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd14d6-5169-4648-b014-94a76fd586ce None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:51.905804 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd14d6-5169-4648-b014-94a76fd586ce None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:51.906011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd14d6-5169-4648-b014-94a76fd586ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:51.923994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-06bd14d6-5169-4648-b014-94a76fd586ce None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:41:51.925244 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-06bd14d6-5169-4648-b014-94a76fd586ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:51.932737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1253/2517] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:41:51.946238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aec53c-b449-4e8f-9bf7-eb6d20da355b service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:51.973178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aec53c-b449-4e8f-9bf7-eb6d20da355b service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:51.978406 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f599a4-5c01-49db-9261-b15c1619f4c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:51.979158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f599a4-5c01-49db-9261-b15c1619f4c8 service swift] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:51.979451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f599a4-5c01-49db-9261-b15c1619f4c8 service swift] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:51.979734 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f599a4-5c01-49db-9261-b15c1619f4c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:51.989944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f599a4-5c01-49db-9261-b15c1619f4c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:51.991998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f599a4-5c01-49db-9261-b15c1619f4c8 service swift] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:52.002765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1265/2518] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:41:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:41:57.655547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd14d6-5169-4648-b014-94a76fd586ce None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:57.656917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-06bd14d6-5169-4648-b014-94a76fd586ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:57.671711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd14d6-5169-4648-b014-94a76fd586ce None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:57.676521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:57.677397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:57.677675 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:57.677985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] PATH_INFO: `/v3/users/4a65b858f4644a619a9c34cb99251efb` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:57.679348 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a65b858f4644a619a9c34cb99251efb)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:57.681363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:57.732855 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a65b858f4644a619a9c34cb99251efb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:57.733523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a65b858f4644a619a9c34cb99251efb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:57.741053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a65b858f4644a619a9c34cb99251efb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:57.741734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a65b858f4644a619a9c34cb99251efb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:57.749487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a65b858f4644a619a9c34cb99251efb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:57.766436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1254/2519] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:41:57 2022] DELETE /identity/v3/users/4a65b858f4644a619a9c34cb99251efb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:41:57.950181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f599a4-5c01-49db-9261-b15c1619f4c8 service swift] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:57.963873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f599a4-5c01-49db-9261-b15c1619f4c8 service swift] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:58.056306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:58.057178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:58.057460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:58.057737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] PATH_INFO: `/v3/projects/d9bb0671fa894da79848c7c46e553b5e` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:58.058948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9bb0671fa894da79848c7c46e553b5e)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:58.060911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:58.113851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9bb0671fa894da79848c7c46e553b5e', 'request_id': 'req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.123718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9bb0671fa894da79848c7c46e553b5e', 'request_id': 'req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.130652 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9bb0671fa894da79848c7c46e553b5e', 'request_id': 'req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.144700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] The token cache is being invalidate because project d9bb0671fa894da79848c7c46e553b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:41:58.145024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.145692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.147335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1266/2520] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:41:57 2022] DELETE /identity/v3/projects/d9bb0671fa894da79848c7c46e553b5e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:41:58.151476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:58.152927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:58.170290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116edb2-7a0c-4ea9-bc1b-aa9ed19c51d6 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:58.228954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:58.229889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:58.230178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:58.230484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] PATH_INFO: `/v3/users/7970929c436b4f608cb5c00e47c31024` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:58.231684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7970929c436b4f608cb5c00e47c31024)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:58.233608 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:58.280129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7970929c436b4f608cb5c00e47c31024'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.281085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7970929c436b4f608cb5c00e47c31024'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.287968 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7970929c436b4f608cb5c00e47c31024'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.288693 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7970929c436b4f608cb5c00e47c31024'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.297230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4542a9af-93db-4890-ae1d-409ae1ad7031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7970929c436b4f608cb5c00e47c31024'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.315758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1255/2521] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:41:58 2022] DELETE /identity/v3/users/7970929c436b4f608cb5c00e47c31024 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:41:58.496984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:41:58.498498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:41:58.518805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e141cb-0d46-42d2-ba3f-3efb0cef6aec admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:41:58.580676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:41:58.581535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:41:58.581818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:41:58.582093 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] PATH_INFO: `/v3/projects/1fdc3cb330c641f8964219da72fbc161` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:41:58.583326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdc3cb330c641f8964219da72fbc161)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:41:58.585251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:41:58.632456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdc3cb330c641f8964219da72fbc161', 'request_id': 'req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.641105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdc3cb330c641f8964219da72fbc161', 'request_id': 'req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.646670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdc3cb330c641f8964219da72fbc161', 'request_id': 'req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.658130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] The token cache is being invalidate because project 1fdc3cb330c641f8964219da72fbc161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:41:58.658415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.659073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:41:58.660698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1267/2522] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:41:58 2022] DELETE /identity/v3/projects/1fdc3cb330c641f8964219da72fbc161 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:42:23.147418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f947c53-43f7-4507-9547-cdbd91c10a71 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:23.147932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f947c53-43f7-4507-9547-cdbd91c10a71 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:23.148115 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f947c53-43f7-4507-9547-cdbd91c10a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:23.166886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5f947c53-43f7-4507-9547-cdbd91c10a71 None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:42:23.168746 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5f947c53-43f7-4507-9547-cdbd91c10a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:23.222298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1256/2523] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 12 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:42:23.236793 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:23.238168 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:23.307430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bb2e6-e34b-4bbc-a2e0-da1a5950a243 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:23.312407 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338e521-4959-4be6-8b41-cd5a8e14f8e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:23.313047 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338e521-4959-4be6-8b41-cd5a8e14f8e6 service swift] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:23.313329 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338e521-4959-4be6-8b41-cd5a8e14f8e6 service swift] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:23.313614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338e521-4959-4be6-8b41-cd5a8e14f8e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:23.321826 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338e521-4959-4be6-8b41-cd5a8e14f8e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:23.323452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338e521-4959-4be6-8b41-cd5a8e14f8e6 service swift] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:23.331957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1268/2524] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:42:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:42:26.993500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f947c53-43f7-4507-9547-cdbd91c10a71 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:26.996799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5f947c53-43f7-4507-9547-cdbd91c10a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:27.072153 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f947c53-43f7-4507-9547-cdbd91c10a71 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:27.078308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bd26-2477-411a-93ae-677527061a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:27.079015 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bd26-2477-411a-93ae-677527061a0c service nova] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:27.079320 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bd26-2477-411a-93ae-677527061a0c service nova] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:27.079596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7bd26-2477-411a-93ae-677527061a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:27.081333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-21a7bd26-2477-411a-93ae-677527061a0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:27.094184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7bd26-2477-411a-93ae-677527061a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:27.095817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7bd26-2477-411a-93ae-677527061a0c service nova] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:27.106181 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1257/2525] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:42:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:42:27.657768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140db96c-df23-4afc-b103-de9591d52788 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:27.658212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140db96c-df23-4afc-b103-de9591d52788 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:27.658357 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140db96c-df23-4afc-b103-de9591d52788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:27.675602 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-140db96c-df23-4afc-b103-de9591d52788 None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:42:27.676791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-140db96c-df23-4afc-b103-de9591d52788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:27.684338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1269/2526] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 12 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:42:27.696326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bd26-2477-411a-93ae-677527061a0c service nova] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:27.708293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7bd26-2477-411a-93ae-677527061a0c service nova] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:27.713324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0eeea-1e20-45e4-960a-e99bf8361990 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:27.713956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0eeea-1e20-45e4-960a-e99bf8361990 service swift] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:27.714243 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0eeea-1e20-45e4-960a-e99bf8361990 service swift] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:27.714523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd0eeea-1e20-45e4-960a-e99bf8361990 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:27.726129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0eeea-1e20-45e4-960a-e99bf8361990 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:27.727821 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd0eeea-1e20-45e4-960a-e99bf8361990 service swift] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:27.736577 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1258/2527] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:42:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 12 14:42:34.467259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140db96c-df23-4afc-b103-de9591d52788 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:34.468666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-140db96c-df23-4afc-b103-de9591d52788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:34.532043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140db96c-df23-4afc-b103-de9591d52788 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:34.536480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:34.537336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:34.537626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:34.537900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] PATH_INFO: `/v3/users/e3a87d665be74a73ae84e15c39b735ad` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:34.539129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a87d665be74a73ae84e15c39b735ad)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:34.541053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:34.586326 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a87d665be74a73ae84e15c39b735ad'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:34.593014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a87d665be74a73ae84e15c39b735ad'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:34.593593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a87d665be74a73ae84e15c39b735ad'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:34.594227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a87d665be74a73ae84e15c39b735ad'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:34.605986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a87d665be74a73ae84e15c39b735ad'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:34.617613 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1270/2528] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:42:34 2022] DELETE /identity/v3/users/e3a87d665be74a73ae84e15c39b735ad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:42:34.782202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0eeea-1e20-45e4-960a-e99bf8361990 service swift] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:34.794124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd0eeea-1e20-45e4-960a-e99bf8361990 service swift] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:34.856300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:34.857083 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:34.857362 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:34.857633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] PATH_INFO: `/v3/projects/9462307fa603476baafa1c5c8ae491d5` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:34.858808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9462307fa603476baafa1c5c8ae491d5)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:34.860762 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:34.905074 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9462307fa603476baafa1c5c8ae491d5', 'request_id': 'req-2f0ea00d-a7f1-474b-8d89-e7f79335a371'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:34.910827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9462307fa603476baafa1c5c8ae491d5', 'request_id': 'req-2f0ea00d-a7f1-474b-8d89-e7f79335a371'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:34.916182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9462307fa603476baafa1c5c8ae491d5', 'request_id': 'req-2f0ea00d-a7f1-474b-8d89-e7f79335a371'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:34.928539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] The token cache is being invalidate because project 9462307fa603476baafa1c5c8ae491d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:42:34.928848 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:34.929484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:34.931022 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1259/2529] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:42:34 2022] DELETE /identity/v3/projects/9462307fa603476baafa1c5c8ae491d5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:42:34.934998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:34.936414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:34.949263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430527-1f4b-4133-8334-82bf265bb7a4 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:35.009107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:35.010009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:35.010295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:35.010573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] PATH_INFO: `/v3/users/e6bb17e076a04bb7b1e79d37bba7f432` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:35.011855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6bb17e076a04bb7b1e79d37bba7f432)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:35.013799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:35.057462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6bb17e076a04bb7b1e79d37bba7f432'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:35.064302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6bb17e076a04bb7b1e79d37bba7f432'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:35.064960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6bb17e076a04bb7b1e79d37bba7f432'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:35.065565 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6bb17e076a04bb7b1e79d37bba7f432'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:35.076855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6bb17e076a04bb7b1e79d37bba7f432'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:35.090370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1271/2530] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:42:34 2022] DELETE /identity/v3/users/e6bb17e076a04bb7b1e79d37bba7f432 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:42:35.255911 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:42:35.257464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:42:35.271674 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ea00d-a7f1-474b-8d89-e7f79335a371 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:42:35.329227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:42:35.330095 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:42:35.330382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:42:35.330662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] PATH_INFO: `/v3/projects/3e0c9753b3bd44e49e71379e14e32f56` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:42:35.331892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0c9753b3bd44e49e71379e14e32f56)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:42:35.333839 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:42:35.379433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0c9753b3bd44e49e71379e14e32f56', 'request_id': 'req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:35.385383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0c9753b3bd44e49e71379e14e32f56', 'request_id': 'req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:35.391265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0c9753b3bd44e49e71379e14e32f56', 'request_id': 'req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:35.403490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] The token cache is being invalidate because project 3e0c9753b3bd44e49e71379e14e32f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:42:35.403774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:35.404413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:42:35.405937 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1260/2531] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:42:35 2022] DELETE /identity/v3/projects/3e0c9753b3bd44e49e71379e14e32f56 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:07.161082 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:07.162524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:07.236895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b88e115-efde-49b5-95a6-211e0c1fa842 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:07.296377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38895f-42a0-4d7d-9e2b-00087eebf996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:07.297004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38895f-42a0-4d7d-9e2b-00087eebf996 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:07.297288 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38895f-42a0-4d7d-9e2b-00087eebf996 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:07.297566 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38895f-42a0-4d7d-9e2b-00087eebf996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:07.299390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2c38895f-42a0-4d7d-9e2b-00087eebf996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:07.374988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38895f-42a0-4d7d-9e2b-00087eebf996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:07.376669 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38895f-42a0-4d7d-9e2b-00087eebf996 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:07.394718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1272/2532] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:27.181019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:27.182444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:27.285752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d851-f7ff-4c5e-b04d-4a0b0d66b5ab admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:27.289476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a03832-bd82-40e6-af0f-892690c7cd93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:27.290120 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03832-bd82-40e6-af0f-892690c7cd93 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:27.290400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03832-bd82-40e6-af0f-892690c7cd93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:27.290670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a03832-bd82-40e6-af0f-892690c7cd93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:27.292462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-12a03832-bd82-40e6-af0f-892690c7cd93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:27.392932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a03832-bd82-40e6-af0f-892690c7cd93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:27.394269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a03832-bd82-40e6-af0f-892690c7cd93 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:27.413135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1261/2533] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:30.710916 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38895f-42a0-4d7d-9e2b-00087eebf996 service nova] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:30.712513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2c38895f-42a0-4d7d-9e2b-00087eebf996 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:30.759754 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38895f-42a0-4d7d-9e2b-00087eebf996 service nova] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:30.764345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:30.765239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:30.765523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:30.765803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] PATH_INFO: `/v3/users/c6422873a3b84aac88f8a93291bcd7b0` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:30.767002 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6422873a3b84aac88f8a93291bcd7b0)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:30.768964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:30.815236 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6422873a3b84aac88f8a93291bcd7b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:30.821865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6422873a3b84aac88f8a93291bcd7b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:30.822533 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6422873a3b84aac88f8a93291bcd7b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:30.823191 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6422873a3b84aac88f8a93291bcd7b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:30.834397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-49e748b5-c5e5-421a-be14-283c320d6df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6422873a3b84aac88f8a93291bcd7b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:30.847622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1273/2534] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:43:30 2022] DELETE /identity/v3/users/c6422873a3b84aac88f8a93291bcd7b0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:31.011542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a03832-bd82-40e6-af0f-892690c7cd93 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:31.021985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a03832-bd82-40e6-af0f-892690c7cd93 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:31.076783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:31.078174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.078440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.078716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] PATH_INFO: `/v3/projects/e4b5ca018b5f4dda99486407424b8168` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.079963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b5ca018b5f4dda99486407424b8168)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:31.081861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:31.125922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b5ca018b5f4dda99486407424b8168', 'request_id': 'req-f6a05b34-c7d3-4841-8c08-b71266cdd42d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:31.131961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b5ca018b5f4dda99486407424b8168', 'request_id': 'req-f6a05b34-c7d3-4841-8c08-b71266cdd42d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:31.137184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b5ca018b5f4dda99486407424b8168', 'request_id': 'req-f6a05b34-c7d3-4841-8c08-b71266cdd42d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:31.149745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] The token cache is being invalidate because project e4b5ca018b5f4dda99486407424b8168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:43:31.149962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:31.150604 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f6a05b34-c7d3-4841-8c08-b71266cdd42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:31.152225 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1262/2535] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:43:31 2022] DELETE /identity/v3/projects/e4b5ca018b5f4dda99486407424b8168 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:31.157741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76deeedf-52cb-4e38-94dd-47ec8007d903 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.158031 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76deeedf-52cb-4e38-94dd-47ec8007d903 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.158307 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76deeedf-52cb-4e38-94dd-47ec8007d903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.203994 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-76deeedf-52cb-4e38-94dd-47ec8007d903 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:31.205207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-76deeedf-52cb-4e38-94dd-47ec8007d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:31.275111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1274/2536] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:31.276809 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404017fb-285f-4b1c-8a04-9df4dc4a09bc None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.277106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404017fb-285f-4b1c-8a04-9df4dc4a09bc None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.277388 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404017fb-285f-4b1c-8a04-9df4dc4a09bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.297685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-404017fb-285f-4b1c-8a04-9df4dc4a09bc None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:31.299056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-404017fb-285f-4b1c-8a04-9df4dc4a09bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:31.307228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1263/2537] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:31.311692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76deeedf-52cb-4e38-94dd-47ec8007d903 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:31.323269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76deeedf-52cb-4e38-94dd-47ec8007d903 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:31.329124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd61d0b-bc0c-4e12-a568-43c16275264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:31.329935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd61d0b-bc0c-4e12-a568-43c16275264a admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.330230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd61d0b-bc0c-4e12-a568-43c16275264a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.330558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd61d0b-bc0c-4e12-a568-43c16275264a admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.331608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd61d0b-bc0c-4e12-a568-43c16275264a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:43:31.331963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd61d0b-bc0c-4e12-a568-43c16275264a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:31.333726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd61d0b-bc0c-4e12-a568-43c16275264a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:31.346283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1275/2538] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:43:31.350400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404017fb-285f-4b1c-8a04-9df4dc4a09bc None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:31.360473 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404017fb-285f-4b1c-8a04-9df4dc4a09bc None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:31.365259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd45146-0710-495a-8340-63ea149747dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:31.365920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd45146-0710-495a-8340-63ea149747dd admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.366202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd45146-0710-495a-8340-63ea149747dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.366480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd45146-0710-495a-8340-63ea149747dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.367585 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd45146-0710-495a-8340-63ea149747dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:31.369766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd45146-0710-495a-8340-63ea149747dd admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:31.397273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1264/2539] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:43:31 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:31.401447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd61d0b-bc0c-4e12-a568-43c16275264a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:31.411958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd61d0b-bc0c-4e12-a568-43c16275264a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:31.470709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3244b-a8e0-43e2-b8c9-80b5645ab433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:31.471422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3244b-a8e0-43e2-b8c9-80b5645ab433 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.471699 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3244b-a8e0-43e2-b8c9-80b5645ab433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.471970 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3244b-a8e0-43e2-b8c9-80b5645ab433 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.472672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3244b-a8e0-43e2-b8c9-80b5645ab433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:31.474588 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3244b-a8e0-43e2-b8c9-80b5645ab433 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:31.497482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1276/2540] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:43:31 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:31.499524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd45146-0710-495a-8340-63ea149747dd admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:31.509831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd45146-0710-495a-8340-63ea149747dd admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:31.516213 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c3c49-b47f-46c9-b6e1-45b917b3ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:31.517013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c3c49-b47f-46c9-b6e1-45b917b3ef4c admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.517369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c3c49-b47f-46c9-b6e1-45b917b3ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.517690 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c3c49-b47f-46c9-b6e1-45b917b3ef4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.518460 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c3c49-b47f-46c9-b6e1-45b917b3ef4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:31.520140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c3c49-b47f-46c9-b6e1-45b917b3ef4c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:31.531393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1265/2541] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:43:31.536053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3244b-a8e0-43e2-b8c9-80b5645ab433 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:31.547352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3244b-a8e0-43e2-b8c9-80b5645ab433 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:31.554773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06fbac-6e1a-4406-a041-3b171d1c0928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:31.555654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06fbac-6e1a-4406-a041-3b171d1c0928 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.555989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06fbac-6e1a-4406-a041-3b171d1c0928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.556922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06fbac-6e1a-4406-a041-3b171d1c0928 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.557693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06fbac-6e1a-4406-a041-3b171d1c0928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:31.559497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06fbac-6e1a-4406-a041-3b171d1c0928 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:31.577056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1277/2542] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:31.578830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c3c49-b47f-46c9-b6e1-45b917b3ef4c admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:31.588945 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c3c49-b47f-46c9-b6e1-45b917b3ef4c admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:31.593636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2e11e-c482-4a7e-b9fa-ad307f472184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:31.594520 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2e11e-c482-4a7e-b9fa-ad307f472184 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.594797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2e11e-c482-4a7e-b9fa-ad307f472184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.595092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2e11e-c482-4a7e-b9fa-ad307f472184 admin admin] PATH_INFO: `/v3/projects/20fbd1683aa4456187d47065af8ddd82/users/33376b1dea734545a6aaa9b9d927f13b/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.610646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2e11e-c482-4a7e-b9fa-ad307f472184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fbd1683aa4456187d47065af8ddd82, user_id=33376b1dea734545a6aaa9b9d927f13b, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:31.613421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2e11e-c482-4a7e-b9fa-ad307f472184 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:31.628540 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1266/2543] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:31 2022] PUT /identity/v3/projects/20fbd1683aa4456187d47065af8ddd82/users/33376b1dea734545a6aaa9b9d927f13b/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:31.633767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895a8e-c93c-4358-8b48-cfdf21690fea None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.634063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895a8e-c93c-4358-8b48-cfdf21690fea None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.634339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b895a8e-c93c-4358-8b48-cfdf21690fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.652670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-1b895a8e-c93c-4358-8b48-cfdf21690fea None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:31.653813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1b895a8e-c93c-4358-8b48-cfdf21690fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:31.714196 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1278/2544] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:31.723596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2e11e-c482-4a7e-b9fa-ad307f472184 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:31.725301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9fe2e11e-c482-4a7e-b9fa-ad307f472184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:31.785660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2e11e-c482-4a7e-b9fa-ad307f472184 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:31.789333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344a49a-b09f-42c7-ac3f-b8355ad720ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:31.789981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344a49a-b09f-42c7-ac3f-b8355ad720ff service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:31.790267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344a49a-b09f-42c7-ac3f-b8355ad720ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:31.790547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344a49a-b09f-42c7-ac3f-b8355ad720ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:31.800044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344a49a-b09f-42c7-ac3f-b8355ad720ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:31.801480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344a49a-b09f-42c7-ac3f-b8355ad720ff service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:31.810687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1267/2545] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:32.414263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f7ed-3aff-4ea3-814c-77592c76146c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:32.414557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f7ed-3aff-4ea3-814c-77592c76146c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:32.414838 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f7ed-3aff-4ea3-814c-77592c76146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:32.441090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-7036f7ed-3aff-4ea3-814c-77592c76146c None None] MFA Rules not processed for user `33376b1dea734545a6aaa9b9d927f13b`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:32.442226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-7036f7ed-3aff-4ea3-814c-77592c76146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:32.506555 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1279/2546] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:32.511120 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344a49a-b09f-42c7-ac3f-b8355ad720ff service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:32.522182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344a49a-b09f-42c7-ac3f-b8355ad720ff service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:32.526787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7117f81-efee-447e-bb93-4d71d852c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:32.527502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117f81-efee-447e-bb93-4d71d852c0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:32.527786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117f81-efee-447e-bb93-4d71d852c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:32.528060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7117f81-efee-447e-bb93-4d71d852c0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:32.528742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7117f81-efee-447e-bb93-4d71d852c0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:32.531256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7117f81-efee-447e-bb93-4d71d852c0b4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:32.559464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1268/2547] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:43:32 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:32.563380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036f7ed-3aff-4ea3-814c-77592c76146c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:32.573978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036f7ed-3aff-4ea3-814c-77592c76146c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:32.632417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39786872-6aab-4323-83d1-c95a6a767ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:32.633461 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39786872-6aab-4323-83d1-c95a6a767ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:32.633748 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39786872-6aab-4323-83d1-c95a6a767ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:32.634024 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39786872-6aab-4323-83d1-c95a6a767ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:32.634743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39786872-6aab-4323-83d1-c95a6a767ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:32.636802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39786872-6aab-4323-83d1-c95a6a767ba5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:32.658978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1280/2548] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:43:32 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:32.663101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7117f81-efee-447e-bb93-4d71d852c0b4 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:32.674476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7117f81-efee-447e-bb93-4d71d852c0b4 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:32.679415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660faa3-09e6-4fd0-b7fd-3dcf5bab7e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:32.680195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660faa3-09e6-4fd0-b7fd-3dcf5bab7e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:32.680553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660faa3-09e6-4fd0-b7fd-3dcf5bab7e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:32.680903 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660faa3-09e6-4fd0-b7fd-3dcf5bab7e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:32.681793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660faa3-09e6-4fd0-b7fd-3dcf5bab7e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:32.683502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660faa3-09e6-4fd0-b7fd-3dcf5bab7e5a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:32.694922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1269/2549] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:32.699140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39786872-6aab-4323-83d1-c95a6a767ba5 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:32.710234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39786872-6aab-4323-83d1-c95a6a767ba5 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:32.715010 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cef297-a088-47eb-8e87-1a6c36d724d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:32.715921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cef297-a088-47eb-8e87-1a6c36d724d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:32.716204 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cef297-a088-47eb-8e87-1a6c36d724d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:32.716479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cef297-a088-47eb-8e87-1a6c36d724d7 admin admin] PATH_INFO: `/v3/projects/a1b32e3effe74677831e48d2af9d9abb/users/884ca675ca5d4e8eb6316bfdb30e2ff8/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:32.731467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cef297-a088-47eb-8e87-1a6c36d724d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b32e3effe74677831e48d2af9d9abb, user_id=884ca675ca5d4e8eb6316bfdb30e2ff8, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:32.735354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cef297-a088-47eb-8e87-1a6c36d724d7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:32.750277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1281/2550] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:32 2022] PUT /identity/v3/projects/a1b32e3effe74677831e48d2af9d9abb/users/884ca675ca5d4e8eb6316bfdb30e2ff8/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:32.754444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660faa3-09e6-4fd0-b7fd-3dcf5bab7e5a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:32.764342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660faa3-09e6-4fd0-b7fd-3dcf5bab7e5a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:32.820105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851491ca-d400-4679-a095-a7ca3b722dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:32.820776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851491ca-d400-4679-a095-a7ca3b722dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:32.821058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851491ca-d400-4679-a095-a7ca3b722dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:32.821334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851491ca-d400-4679-a095-a7ca3b722dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:32.822063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851491ca-d400-4679-a095-a7ca3b722dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:32.823707 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851491ca-d400-4679-a095-a7ca3b722dc4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:32.834361 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1270/2551] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:32.838332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cef297-a088-47eb-8e87-1a6c36d724d7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:32.849246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cef297-a088-47eb-8e87-1a6c36d724d7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:32.853895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731dd01-9a9c-4e19-97dd-869a1f70ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:32.855019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731dd01-9a9c-4e19-97dd-869a1f70ef4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:32.855612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731dd01-9a9c-4e19-97dd-869a1f70ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:32.855889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731dd01-9a9c-4e19-97dd-869a1f70ef4c admin admin] PATH_INFO: `/v3/projects/a1b32e3effe74677831e48d2af9d9abb/users/884ca675ca5d4e8eb6316bfdb30e2ff8/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:32.857941 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731dd01-9a9c-4e19-97dd-869a1f70ef4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b32e3effe74677831e48d2af9d9abb, user_id=884ca675ca5d4e8eb6316bfdb30e2ff8, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:32.860694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731dd01-9a9c-4e19-97dd-869a1f70ef4c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:32.871284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1282/2552] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:32 2022] PUT /identity/v3/projects/a1b32e3effe74677831e48d2af9d9abb/users/884ca675ca5d4e8eb6316bfdb30e2ff8/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:33.498446 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0dca2-1f69-4def-8cef-061754f80fe8 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:33.499004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0dca2-1f69-4def-8cef-061754f80fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:33.499814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0dca2-1f69-4def-8cef-061754f80fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:33.527654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-65b0dca2-1f69-4def-8cef-061754f80fe8 None None] MFA Rules not processed for user `884ca675ca5d4e8eb6316bfdb30e2ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:33.529505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-65b0dca2-1f69-4def-8cef-061754f80fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:33.597375 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1271/2553] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:35.244507 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731dd01-9a9c-4e19-97dd-869a1f70ef4c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:35.311164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731dd01-9a9c-4e19-97dd-869a1f70ef4c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:35.315819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:35.316676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:35.316956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:35.317227 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] PATH_INFO: `/v3/users/33376b1dea734545a6aaa9b9d927f13b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:35.318394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33376b1dea734545a6aaa9b9d927f13b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:35.320451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:35.369807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33376b1dea734545a6aaa9b9d927f13b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.378676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33376b1dea734545a6aaa9b9d927f13b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.379445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33376b1dea734545a6aaa9b9d927f13b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.380065 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33376b1dea734545a6aaa9b9d927f13b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.394415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33376b1dea734545a6aaa9b9d927f13b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.409578 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1283/2554] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:43:35 2022] DELETE /identity/v3/users/33376b1dea734545a6aaa9b9d927f13b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:35.669907 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0dca2-1f69-4def-8cef-061754f80fe8 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:35.690269 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0dca2-1f69-4def-8cef-061754f80fe8 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:35.758039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:35.758909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:35.759224 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:35.759503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] PATH_INFO: `/v3/projects/20fbd1683aa4456187d47065af8ddd82` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:35.760731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fbd1683aa4456187d47065af8ddd82)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:35.762642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:35.808391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fbd1683aa4456187d47065af8ddd82', 'request_id': 'req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.814444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fbd1683aa4456187d47065af8ddd82', 'request_id': 'req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.819886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fbd1683aa4456187d47065af8ddd82', 'request_id': 'req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.836136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] The token cache is being invalidate because project 20fbd1683aa4456187d47065af8ddd82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:43:35.836429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.837059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.838656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1272/2555] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:43:35 2022] DELETE /identity/v3/projects/20fbd1683aa4456187d47065af8ddd82 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:35.843367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:35.844793 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:35.857608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05065dc-cec3-4af0-9900-eb0afcfac32a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:35.913180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:35.914052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:35.914333 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:35.914605 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] PATH_INFO: `/v3/users/884ca675ca5d4e8eb6316bfdb30e2ff8` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:35.915812 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=884ca675ca5d4e8eb6316bfdb30e2ff8)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:35.917728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:35.970116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884ca675ca5d4e8eb6316bfdb30e2ff8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.977925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884ca675ca5d4e8eb6316bfdb30e2ff8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.978647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884ca675ca5d4e8eb6316bfdb30e2ff8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.979571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884ca675ca5d4e8eb6316bfdb30e2ff8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:35.998633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2b9a6a81-ac89-4cc8-bc4a-5dcfd35dc828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884ca675ca5d4e8eb6316bfdb30e2ff8'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:36.020052 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1284/2556] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:43:35 2022] DELETE /identity/v3/users/884ca675ca5d4e8eb6316bfdb30e2ff8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:36.219670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:36.221156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:36.240210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77b564-06c2-4a77-8220-8fbd4f41b5a8 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:36.298579 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:36.299487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.299769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.300045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] PATH_INFO: `/v3/projects/a1b32e3effe74677831e48d2af9d9abb` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.301267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b32e3effe74677831e48d2af9d9abb)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:36.303252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:36.351166 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b32e3effe74677831e48d2af9d9abb', 'request_id': 'req-cb72224c-c442-4083-8084-0cadaded1d49'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:36.357330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b32e3effe74677831e48d2af9d9abb', 'request_id': 'req-cb72224c-c442-4083-8084-0cadaded1d49'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:36.363239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b32e3effe74677831e48d2af9d9abb', 'request_id': 'req-cb72224c-c442-4083-8084-0cadaded1d49'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:36.376635 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] The token cache is being invalidate because project a1b32e3effe74677831e48d2af9d9abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:43:36.376928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:36.377582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cb72224c-c442-4083-8084-0cadaded1d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:36.379154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1273/2557] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:43:36 2022] DELETE /identity/v3/projects/a1b32e3effe74677831e48d2af9d9abb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:36.384017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238d281-35b7-4f5b-bced-12a4c1274c68 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.384491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238d281-35b7-4f5b-bced-12a4c1274c68 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.384725 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238d281-35b7-4f5b-bced-12a4c1274c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.404040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-8238d281-35b7-4f5b-bced-12a4c1274c68 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:36.405278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8238d281-35b7-4f5b-bced-12a4c1274c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:36.465036 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1285/2558] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:36.472580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af2d0-74b3-4977-bde6-08873b0f6769 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.472874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af2d0-74b3-4977-bde6-08873b0f6769 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.473159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54af2d0-74b3-4977-bde6-08873b0f6769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.492438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-d54af2d0-74b3-4977-bde6-08873b0f6769 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:36.494188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d54af2d0-74b3-4977-bde6-08873b0f6769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:36.508124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1274/2559] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:36.510172 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238d281-35b7-4f5b-bced-12a4c1274c68 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:36.519893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238d281-35b7-4f5b-bced-12a4c1274c68 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:36.524898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfdb9e-54f2-45fa-a9b3-0f077529e7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:36.525571 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfdb9e-54f2-45fa-a9b3-0f077529e7bd admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.525856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfdb9e-54f2-45fa-a9b3-0f077529e7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.526140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfdb9e-54f2-45fa-a9b3-0f077529e7bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.526878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfdb9e-54f2-45fa-a9b3-0f077529e7bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:43:36.527223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfdb9e-54f2-45fa-a9b3-0f077529e7bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:36.528858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfdb9e-54f2-45fa-a9b3-0f077529e7bd admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:36.541315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1286/2560] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:43:36.545625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af2d0-74b3-4977-bde6-08873b0f6769 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:36.555391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54af2d0-74b3-4977-bde6-08873b0f6769 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:36.560017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b296-3e11-446f-9700-adf216c0d492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:36.560662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b296-3e11-446f-9700-adf216c0d492 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.560938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b296-3e11-446f-9700-adf216c0d492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.561211 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871b296-3e11-446f-9700-adf216c0d492 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.562624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871b296-3e11-446f-9700-adf216c0d492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:36.564569 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871b296-3e11-446f-9700-adf216c0d492 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:36.589880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1275/2561] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:43:36 2022] POST /identity/v3/projects => generated 393 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:36.594700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfdb9e-54f2-45fa-a9b3-0f077529e7bd admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:36.604370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfdb9e-54f2-45fa-a9b3-0f077529e7bd admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:36.658158 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad9200-74ab-4a79-99f2-0de5065fa46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:36.658818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad9200-74ab-4a79-99f2-0de5065fa46e admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.659124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad9200-74ab-4a79-99f2-0de5065fa46e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.659399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad9200-74ab-4a79-99f2-0de5065fa46e admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.660083 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad9200-74ab-4a79-99f2-0de5065fa46e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:36.661989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad9200-74ab-4a79-99f2-0de5065fa46e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:36.680839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1287/2562] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:43:36 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:43:36.684994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b296-3e11-446f-9700-adf216c0d492 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:36.695787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871b296-3e11-446f-9700-adf216c0d492 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:36.700389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7af49-c629-4df0-8088-64fce208d0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:36.701034 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7af49-c629-4df0-8088-64fce208d0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.701315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7af49-c629-4df0-8088-64fce208d0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.701589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7af49-c629-4df0-8088-64fce208d0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.702859 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7af49-c629-4df0-8088-64fce208d0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:36.704471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7af49-c629-4df0-8088-64fce208d0d1 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:36.714501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1276/2563] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:36.719063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad9200-74ab-4a79-99f2-0de5065fa46e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:36.728756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad9200-74ab-4a79-99f2-0de5065fa46e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:36.733284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdc31c-7f7f-497d-baf9-f4de72a319eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:36.733927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdc31c-7f7f-497d-baf9-f4de72a319eb admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.734205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdc31c-7f7f-497d-baf9-f4de72a319eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.734477 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdc31c-7f7f-497d-baf9-f4de72a319eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.735219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdc31c-7f7f-497d-baf9-f4de72a319eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:36.736795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdc31c-7f7f-497d-baf9-f4de72a319eb admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:36.746522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1288/2564] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:36.750836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7af49-c629-4df0-8088-64fce208d0d1 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:36.760857 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7af49-c629-4df0-8088-64fce208d0d1 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:36.766075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6b6ce-8cbc-461a-a2b8-c6553ef60720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:36.766943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b6ce-8cbc-461a-a2b8-c6553ef60720 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.767253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b6ce-8cbc-461a-a2b8-c6553ef60720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.767530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6b6ce-8cbc-461a-a2b8-c6553ef60720 admin admin] PATH_INFO: `/v3/projects/d8c7201516e240fda934fbb14372b5fa/users/6e1c924b4c834d4a977a303d96e07d09/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.784087 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6b6ce-8cbc-461a-a2b8-c6553ef60720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c7201516e240fda934fbb14372b5fa, user_id=6e1c924b4c834d4a977a303d96e07d09, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:36.786851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6b6ce-8cbc-461a-a2b8-c6553ef60720 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:36.802692 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1277/2565] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:36 2022] PUT /identity/v3/projects/d8c7201516e240fda934fbb14372b5fa/users/6e1c924b4c834d4a977a303d96e07d09/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:36.815644 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330ae9f-d531-4da3-a686-20aac0ef4e35 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.816000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330ae9f-d531-4da3-a686-20aac0ef4e35 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.817018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330ae9f-d531-4da3-a686-20aac0ef4e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.843097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-2330ae9f-d531-4da3-a686-20aac0ef4e35 None None] MFA Rules not processed for user `6e1c924b4c834d4a977a303d96e07d09`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:36.844325 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-2330ae9f-d531-4da3-a686-20aac0ef4e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:36.907088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1289/2566] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:36.911477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6b6ce-8cbc-461a-a2b8-c6553ef60720 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:36.982512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6b6ce-8cbc-461a-a2b8-c6553ef60720 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:36.987244 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7980a9-0833-462a-9740-b937544f1af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:36.987934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7980a9-0833-462a-9740-b937544f1af2 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:36.988378 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7980a9-0833-462a-9740-b937544f1af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:36.988658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7980a9-0833-462a-9740-b937544f1af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:36.989749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7980a9-0833-462a-9740-b937544f1af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:36.991901 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7980a9-0833-462a-9740-b937544f1af2 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:37.021629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1278/2567] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:43:36 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:37.025731 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330ae9f-d531-4da3-a686-20aac0ef4e35 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:37.036681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330ae9f-d531-4da3-a686-20aac0ef4e35 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:37.091903 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802055a-2f9e-494f-b74d-827774792070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:37.092614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802055a-2f9e-494f-b74d-827774792070 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:37.092909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802055a-2f9e-494f-b74d-827774792070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:37.093180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802055a-2f9e-494f-b74d-827774792070 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:37.093866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802055a-2f9e-494f-b74d-827774792070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:37.095864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802055a-2f9e-494f-b74d-827774792070 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:37.118033 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1290/2568] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:43:37 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:37.122197 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7980a9-0833-462a-9740-b937544f1af2 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:37.135627 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7980a9-0833-462a-9740-b937544f1af2 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:37.140852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae167-86f0-4727-b66e-16a8d169d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:37.141589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae167-86f0-4727-b66e-16a8d169d457 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:37.141871 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae167-86f0-4727-b66e-16a8d169d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:37.142151 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae167-86f0-4727-b66e-16a8d169d457 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:37.142879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ae167-86f0-4727-b66e-16a8d169d457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:37.144614 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ae167-86f0-4727-b66e-16a8d169d457 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:37.167006 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1279/2569] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:37.168195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802055a-2f9e-494f-b74d-827774792070 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:37.179352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802055a-2f9e-494f-b74d-827774792070 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:37.184524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f9c75-28d2-4913-8cfe-44972b9c689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:37.185794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9c75-28d2-4913-8cfe-44972b9c689a admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:37.186115 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9c75-28d2-4913-8cfe-44972b9c689a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:37.186384 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f9c75-28d2-4913-8cfe-44972b9c689a admin admin] PATH_INFO: `/v3/projects/0121a668ad2f499d94a074c6aa024d21/users/f1b31e15db844b3792f8a51dbf04280a/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:37.201993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f9c75-28d2-4913-8cfe-44972b9c689a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0121a668ad2f499d94a074c6aa024d21, user_id=f1b31e15db844b3792f8a51dbf04280a, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:37.204995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f9c75-28d2-4913-8cfe-44972b9c689a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:37.218043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1291/2570] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:37 2022] PUT /identity/v3/projects/0121a668ad2f499d94a074c6aa024d21/users/f1b31e15db844b3792f8a51dbf04280a/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:37.222038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae167-86f0-4727-b66e-16a8d169d457 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:37.232004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae167-86f0-4727-b66e-16a8d169d457 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:37.288469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d810786-567a-4344-8609-d0689d65f007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:37.289174 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d810786-567a-4344-8609-d0689d65f007 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:37.289459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d810786-567a-4344-8609-d0689d65f007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:37.289735 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d810786-567a-4344-8609-d0689d65f007 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:37.290462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d810786-567a-4344-8609-d0689d65f007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:37.292090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d810786-567a-4344-8609-d0689d65f007 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:37.305841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1280/2571] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:37.307324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f9c75-28d2-4913-8cfe-44972b9c689a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:37.318350 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f9c75-28d2-4913-8cfe-44972b9c689a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:37.323129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed055-2915-4d34-a5a5-b3532834ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:37.324044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed055-2915-4d34-a5a5-b3532834ecec admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:37.324335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed055-2915-4d34-a5a5-b3532834ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:37.324587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed055-2915-4d34-a5a5-b3532834ecec admin admin] PATH_INFO: `/v3/projects/0121a668ad2f499d94a074c6aa024d21/users/f1b31e15db844b3792f8a51dbf04280a/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:37.326680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ed055-2915-4d34-a5a5-b3532834ecec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0121a668ad2f499d94a074c6aa024d21, user_id=f1b31e15db844b3792f8a51dbf04280a, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:37.329472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ed055-2915-4d34-a5a5-b3532834ecec admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:37.340709 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1292/2572] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:37 2022] PUT /identity/v3/projects/0121a668ad2f499d94a074c6aa024d21/users/f1b31e15db844b3792f8a51dbf04280a/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:37.351170 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa559-25e8-4b25-84f8-21e41971f145 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:37.351669 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa559-25e8-4b25-84f8-21e41971f145 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:37.352122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa559-25e8-4b25-84f8-21e41971f145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:37.386128 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-499fa559-25e8-4b25-84f8-21e41971f145 None None] MFA Rules not processed for user `f1b31e15db844b3792f8a51dbf04280a`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:37.387377 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-499fa559-25e8-4b25-84f8-21e41971f145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:37.458351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1281/2573] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:37.469597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed055-2915-4d34-a5a5-b3532834ecec admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:37.471469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-971ed055-2915-4d34-a5a5-b3532834ecec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:37.534096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed055-2915-4d34-a5a5-b3532834ecec admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:37.537716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246d08-d68f-4b2d-b175-e8170cfc05d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:37.538363 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246d08-d68f-4b2d-b175-e8170cfc05d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:37.538644 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246d08-d68f-4b2d-b175-e8170cfc05d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:37.538921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246d08-d68f-4b2d-b175-e8170cfc05d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:37.548782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76246d08-d68f-4b2d-b175-e8170cfc05d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:37.550711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76246d08-d68f-4b2d-b175-e8170cfc05d3 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:37.560815 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1293/2574] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:37.610920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa559-25e8-4b25-84f8-21e41971f145 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:37.620865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa559-25e8-4b25-84f8-21e41971f145 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:37.625311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8bf7-cf0f-43e5-8587-03d2e3c8f64b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:37.626038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8bf7-cf0f-43e5-8587-03d2e3c8f64b service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:37.626385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8bf7-cf0f-43e5-8587-03d2e3c8f64b service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:37.626669 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8bf7-cf0f-43e5-8587-03d2e3c8f64b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:37.682404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf8bf7-cf0f-43e5-8587-03d2e3c8f64b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:37.683865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf8bf7-cf0f-43e5-8587-03d2e3c8f64b service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:37.692711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1282/2575] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:39.927962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246d08-d68f-4b2d-b175-e8170cfc05d3 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:39.929580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-76246d08-d68f-4b2d-b175-e8170cfc05d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:39.985757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246d08-d68f-4b2d-b175-e8170cfc05d3 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:39.989432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e87de8-1d86-4231-9072-12c9c4a47a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:39.990102 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87de8-1d86-4231-9072-12c9c4a47a4e service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:39.990444 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87de8-1d86-4231-9072-12c9c4a47a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:39.990724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e87de8-1d86-4231-9072-12c9c4a47a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:39.992733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e3e87de8-1d86-4231-9072-12c9c4a47a4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:40.056049 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e87de8-1d86-4231-9072-12c9c4a47a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:40.057489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e87de8-1d86-4231-9072-12c9c4a47a4e service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:40.067722 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1294/2576] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:40.920624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8bf7-cf0f-43e5-8587-03d2e3c8f64b service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:40.932047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8bf7-cf0f-43e5-8587-03d2e3c8f64b service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:40.940262 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:40.941406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:40.941975 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:40.942436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] PATH_INFO: `/v3/users/6e1c924b4c834d4a977a303d96e07d09` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:40.943931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1c924b4c834d4a977a303d96e07d09)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:40.946861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:41.003919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1c924b4c834d4a977a303d96e07d09'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.004588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1c924b4c834d4a977a303d96e07d09'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.012212 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1c924b4c834d4a977a303d96e07d09'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.012922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1c924b4c834d4a977a303d96e07d09'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.022032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1c924b4c834d4a977a303d96e07d09'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.041230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1283/2577] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:43:40 2022] DELETE /identity/v3/users/6e1c924b4c834d4a977a303d96e07d09 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:41.045339 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8556-0ff0-431c-9063-9fd4599f9a3d None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:41.045890 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8556-0ff0-431c-9063-9fd4599f9a3d None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:41.046006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8556-0ff0-431c-9063-9fd4599f9a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:41.063997 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e8eb8556-0ff0-431c-9063-9fd4599f9a3d None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:41.065296 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e8eb8556-0ff0-431c-9063-9fd4599f9a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:41.134415 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1295/2578] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:41.141317 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:41.143064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:41.201261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2d365-ce27-40a1-937c-1872c3ca40fd admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:41.206314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cd34e-4894-47d5-be5f-774ce022fd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:41.207131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cd34e-4894-47d5-be5f-774ce022fd0f service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:41.207416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cd34e-4894-47d5-be5f-774ce022fd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:41.207693 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cd34e-4894-47d5-be5f-774ce022fd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:41.217739 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cd34e-4894-47d5-be5f-774ce022fd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:41.219235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cd34e-4894-47d5-be5f-774ce022fd0f service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:41.235831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1284/2579] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:41.519900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8556-0ff0-431c-9063-9fd4599f9a3d None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:41.521436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e8eb8556-0ff0-431c-9063-9fd4599f9a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:41.543199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8556-0ff0-431c-9063-9fd4599f9a3d None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:41.548910 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:41.550108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:41.550593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:41.551208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] PATH_INFO: `/v3/projects/d8c7201516e240fda934fbb14372b5fa` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:41.552663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c7201516e240fda934fbb14372b5fa)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:41.555723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:41.602672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c7201516e240fda934fbb14372b5fa', 'request_id': 'req-24485ae2-78e9-40c9-9a52-e339a13d9265'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.611464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c7201516e240fda934fbb14372b5fa', 'request_id': 'req-24485ae2-78e9-40c9-9a52-e339a13d9265'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.617230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c7201516e240fda934fbb14372b5fa', 'request_id': 'req-24485ae2-78e9-40c9-9a52-e339a13d9265'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.629202 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] The token cache is being invalidate because project d8c7201516e240fda934fbb14372b5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:43:41.629491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.630145 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.631737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1296/2580] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:43:41 2022] DELETE /identity/v3/projects/d8c7201516e240fda934fbb14372b5fa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:41.635978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cd34e-4894-47d5-be5f-774ce022fd0f service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:41.646404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cd34e-4894-47d5-be5f-774ce022fd0f service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:41.707927 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:41.708908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:41.709264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:41.709618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] PATH_INFO: `/v3/users/f1b31e15db844b3792f8a51dbf04280a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:41.710940 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b31e15db844b3792f8a51dbf04280a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:41.713049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:41.764180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b31e15db844b3792f8a51dbf04280a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.765005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b31e15db844b3792f8a51dbf04280a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.772055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b31e15db844b3792f8a51dbf04280a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.772736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b31e15db844b3792f8a51dbf04280a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.781650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3501b51b-e6af-41dc-953f-c4667076f8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b31e15db844b3792f8a51dbf04280a'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:41.805503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1285/2581] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:43:41 2022] DELETE /identity/v3/users/f1b31e15db844b3792f8a51dbf04280a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:42.205550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:42.207267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:42.224828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24485ae2-78e9-40c9-9a52-e339a13d9265 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:42.291769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:42.292663 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:42.292946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:42.293224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] PATH_INFO: `/v3/projects/0121a668ad2f499d94a074c6aa024d21` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:42.294466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0121a668ad2f499d94a074c6aa024d21)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:42.297151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:42.350450 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0121a668ad2f499d94a074c6aa024d21', 'request_id': 'req-ab94415d-8c01-4c11-8461-e850a8d2d82a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:42.359928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0121a668ad2f499d94a074c6aa024d21', 'request_id': 'req-ab94415d-8c01-4c11-8461-e850a8d2d82a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:42.366121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0121a668ad2f499d94a074c6aa024d21', 'request_id': 'req-ab94415d-8c01-4c11-8461-e850a8d2d82a'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:42.377686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] The token cache is being invalidate because project 0121a668ad2f499d94a074c6aa024d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:43:42.377969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:42.379133 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-ab94415d-8c01-4c11-8461-e850a8d2d82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:42.383957 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1297/2582] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:43:42 2022] DELETE /identity/v3/projects/0121a668ad2f499d94a074c6aa024d21 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:42.389009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb253b4d-09b0-4fcc-9ac7-996b0b8e8824 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:42.390060 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb253b4d-09b0-4fcc-9ac7-996b0b8e8824 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:42.390194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb253b4d-09b0-4fcc-9ac7-996b0b8e8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:42.410420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-cb253b4d-09b0-4fcc-9ac7-996b0b8e8824 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:42.411985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cb253b4d-09b0-4fcc-9ac7-996b0b8e8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:42.474960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1286/2583] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:43:42.482648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d959d7-94bf-4ace-b68a-3a6638e7a289 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:42.482948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d959d7-94bf-4ace-b68a-3a6638e7a289 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:42.483295 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d959d7-94bf-4ace-b68a-3a6638e7a289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:42.504224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f2d959d7-94bf-4ace-b68a-3a6638e7a289 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:42.505479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f2d959d7-94bf-4ace-b68a-3a6638e7a289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:42.517126 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1298/2584] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:43:42.521548 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb253b4d-09b0-4fcc-9ac7-996b0b8e8824 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:42.532055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb253b4d-09b0-4fcc-9ac7-996b0b8e8824 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:42.536571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3a53-c96d-481c-804a-6598c23e8977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:42.537229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3a53-c96d-481c-804a-6598c23e8977 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:42.537507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3a53-c96d-481c-804a-6598c23e8977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:42.537779 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb3a53-c96d-481c-804a-6598c23e8977 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:42.538512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb3a53-c96d-481c-804a-6598c23e8977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:43:42.538818 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb3a53-c96d-481c-804a-6598c23e8977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:42.540561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb3a53-c96d-481c-804a-6598c23e8977 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:42.552309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1287/2585] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:43:42.556538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d959d7-94bf-4ace-b68a-3a6638e7a289 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:42.565581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d959d7-94bf-4ace-b68a-3a6638e7a289 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:42.570242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599bf98-bd14-4411-a172-a67249aac218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:42.570893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599bf98-bd14-4411-a172-a67249aac218 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:42.571211 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599bf98-bd14-4411-a172-a67249aac218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:42.571493 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599bf98-bd14-4411-a172-a67249aac218 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:42.572197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599bf98-bd14-4411-a172-a67249aac218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:42.574151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599bf98-bd14-4411-a172-a67249aac218 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:42.600552 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1299/2586] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:43:42 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:42.605148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3a53-c96d-481c-804a-6598c23e8977 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:42.615647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb3a53-c96d-481c-804a-6598c23e8977 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:42.677398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056556f-9222-4cb7-9599-e8923b45bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:42.678031 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056556f-9222-4cb7-9599-e8923b45bd82 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:42.678349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056556f-9222-4cb7-9599-e8923b45bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:42.678633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056556f-9222-4cb7-9599-e8923b45bd82 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:42.679368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056556f-9222-4cb7-9599-e8923b45bd82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:42.681337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056556f-9222-4cb7-9599-e8923b45bd82 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:42.703101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1288/2587] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:43:42 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:42.707048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599bf98-bd14-4411-a172-a67249aac218 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:42.717772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599bf98-bd14-4411-a172-a67249aac218 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:42.722665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5f5da-ba5d-4fc2-b70a-ca134e335e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:42.723362 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f5da-ba5d-4fc2-b70a-ca134e335e98 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:42.723648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f5da-ba5d-4fc2-b70a-ca134e335e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:42.723928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f5da-ba5d-4fc2-b70a-ca134e335e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:42.724665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5f5da-ba5d-4fc2-b70a-ca134e335e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:42.726479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5f5da-ba5d-4fc2-b70a-ca134e335e98 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:42.737523 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1300/2588] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:43:42.741660 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056556f-9222-4cb7-9599-e8923b45bd82 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:42.754308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056556f-9222-4cb7-9599-e8923b45bd82 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:42.763094 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374db30-8dd0-43fc-99a8-58b43391ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:42.764064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374db30-8dd0-43fc-99a8-58b43391ebb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:42.767438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374db30-8dd0-43fc-99a8-58b43391ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:42.767656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374db30-8dd0-43fc-99a8-58b43391ebb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:42.768438 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374db30-8dd0-43fc-99a8-58b43391ebb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:42.770077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374db30-8dd0-43fc-99a8-58b43391ebb8 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:42.787079 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1289/2589] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:42.789085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5f5da-ba5d-4fc2-b70a-ca134e335e98 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:42.800258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5f5da-ba5d-4fc2-b70a-ca134e335e98 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:42.811061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1bd68-95ff-4ef1-b8a3-730059f6768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:42.812488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1bd68-95ff-4ef1-b8a3-730059f6768c admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:42.812767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1bd68-95ff-4ef1-b8a3-730059f6768c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:42.813040 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1bd68-95ff-4ef1-b8a3-730059f6768c admin admin] PATH_INFO: `/v3/projects/2adbab81a29f4d5a83408a58c3ca6f38/users/f2961ecee6494edaa40d65cdcedaf4e2/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:42.830848 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1bd68-95ff-4ef1-b8a3-730059f6768c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2adbab81a29f4d5a83408a58c3ca6f38, user_id=f2961ecee6494edaa40d65cdcedaf4e2, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:42.834098 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1bd68-95ff-4ef1-b8a3-730059f6768c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:42.850562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1301/2590] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:42 2022] PUT /identity/v3/projects/2adbab81a29f4d5a83408a58c3ca6f38/users/f2961ecee6494edaa40d65cdcedaf4e2/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:42.855818 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311b94-dda9-4266-b291-062325f63b4c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:42.856168 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311b94-dda9-4266-b291-062325f63b4c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:42.856453 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0311b94-dda9-4266-b291-062325f63b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:42.878593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-e0311b94-dda9-4266-b291-062325f63b4c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:42.879887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e0311b94-dda9-4266-b291-062325f63b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:42.950258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1290/2591] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:42.959810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1bd68-95ff-4ef1-b8a3-730059f6768c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:42.961508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-eec1bd68-95ff-4ef1-b8a3-730059f6768c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:43.020455 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1bd68-95ff-4ef1-b8a3-730059f6768c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:43.024175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f901a-2e2b-4960-837e-d2342e04fd7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:43.024818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f901a-2e2b-4960-837e-d2342e04fd7a service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:43.025103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f901a-2e2b-4960-837e-d2342e04fd7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:43.025383 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f901a-2e2b-4960-837e-d2342e04fd7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:43.035623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f901a-2e2b-4960-837e-d2342e04fd7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:43.037072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f901a-2e2b-4960-837e-d2342e04fd7a service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:43.046865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1302/2592] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:43.431853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311b94-dda9-4266-b291-062325f63b4c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:43.433506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e0311b94-dda9-4266-b291-062325f63b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:43.458599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0311b94-dda9-4266-b291-062325f63b4c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:43.466123 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:43.468117 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:43.468742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:43.469146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] PATH_INFO: `/v3/users/c3b76edcb338405a9bf2f68e91dfacdd` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:43.470522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b76edcb338405a9bf2f68e91dfacdd)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:43.472810 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:43.549295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b76edcb338405a9bf2f68e91dfacdd'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:43.549978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b76edcb338405a9bf2f68e91dfacdd'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:43.556913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b76edcb338405a9bf2f68e91dfacdd'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:43.557828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b76edcb338405a9bf2f68e91dfacdd'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:43.571994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b76edcb338405a9bf2f68e91dfacdd'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:43.590737 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1291/2593] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:43:43 2022] DELETE /identity/v3/users/c3b76edcb338405a9bf2f68e91dfacdd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:43.772302 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050a21-76cc-4868-a2a1-093383666c9e None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:43.772900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050a21-76cc-4868-a2a1-093383666c9e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:43.772900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68050a21-76cc-4868-a2a1-093383666c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:43.789199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:43.790703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:43.819550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-68050a21-76cc-4868-a2a1-093383666c9e None None] MFA Rules not processed for user `f2961ecee6494edaa40d65cdcedaf4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:43.821183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-68050a21-76cc-4868-a2a1-093383666c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:43.879896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876bb25-d25e-48f2-85f4-b8b7959c1320 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:43.884948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:43.885986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:43.886264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:43.886537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] PATH_INFO: `/v3/projects/202791457f0749649e8cc096f6e43404` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:43.887750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=202791457f0749649e8cc096f6e43404)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:43.890289 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:43.899744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1303/2594] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:43.901137 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68050a21-76cc-4868-a2a1-093383666c9e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:43.902611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-68050a21-76cc-4868-a2a1-093383666c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:43.916887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68050a21-76cc-4868-a2a1-093383666c9e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:43.923891 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ec5a4-5a02-4622-88a8-f33d871d4494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:43.924483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ec5a4-5a02-4622-88a8-f33d871d4494 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:43.924768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ec5a4-5a02-4622-88a8-f33d871d4494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:43.925043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ec5a4-5a02-4622-88a8-f33d871d4494 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:43.925744 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ec5a4-5a02-4622-88a8-f33d871d4494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:43.927715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ec5a4-5a02-4622-88a8-f33d871d4494 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:43.940791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '202791457f0749649e8cc096f6e43404', 'request_id': 'req-1675dad9-52a9-4efe-92f8-e2db16855b05'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:43.947299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '202791457f0749649e8cc096f6e43404', 'request_id': 'req-1675dad9-52a9-4efe-92f8-e2db16855b05'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:43.954052 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '202791457f0749649e8cc096f6e43404', 'request_id': 'req-1675dad9-52a9-4efe-92f8-e2db16855b05'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:43.965508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1304/2595] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:43:43 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:43.968121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ec5a4-5a02-4622-88a8-f33d871d4494 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:43.974650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] The token cache is being invalidate because project 202791457f0749649e8cc096f6e43404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:43:43.975059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:43.975607 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1675dad9-52a9-4efe-92f8-e2db16855b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:43.977341 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1292/2596] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:43:43 2022] DELETE /identity/v3/projects/202791457f0749649e8cc096f6e43404 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:43.982132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0bd1c-ce42-4388-bf4d-74d3946fab60 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:43.982432 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0bd1c-ce42-4388-bf4d-74d3946fab60 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:43.982719 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0bd1c-ce42-4388-bf4d-74d3946fab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.001685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-a3c0bd1c-ce42-4388-bf4d-74d3946fab60 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:44.002966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a3c0bd1c-ce42-4388-bf4d-74d3946fab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:44.032129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ec5a4-5a02-4622-88a8-f33d871d4494 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.036773 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb285a89-a190-40df-9951-c0a5c496183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.037440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285a89-a190-40df-9951-c0a5c496183e admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.037732 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285a89-a190-40df-9951-c0a5c496183e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.038032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb285a89-a190-40df-9951-c0a5c496183e admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.038716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb285a89-a190-40df-9951-c0a5c496183e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.040694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb285a89-a190-40df-9951-c0a5c496183e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.063959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1305/2598] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:43:43 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:44.064152 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1293/2598] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:43:44.068164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb285a89-a190-40df-9951-c0a5c496183e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.069165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9f60-a956-4684-9c2b-a356acd77627 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.069463 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9f60-a956-4684-9c2b-a356acd77627 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.069750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9f60-a956-4684-9c2b-a356acd77627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.069875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-bb285a89-a190-40df-9951-c0a5c496183e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:44.081696 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb285a89-a190-40df-9951-c0a5c496183e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.086402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbeeaa-f5da-4a67-9e9a-45f05c0ccd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.087086 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbeeaa-f5da-4a67-9e9a-45f05c0ccd44 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.087376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbeeaa-f5da-4a67-9e9a-45f05c0ccd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.087486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-214f9f60-a956-4684-9c2b-a356acd77627 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:44.087685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbeeaa-f5da-4a67-9e9a-45f05c0ccd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.088417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbeeaa-f5da-4a67-9e9a-45f05c0ccd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.088647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-214f9f60-a956-4684-9c2b-a356acd77627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:44.090019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bbeeaa-f5da-4a67-9e9a-45f05c0ccd44 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.096563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1294/2599] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:43:44.100070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1306/2600] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:43:44.101119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f9f60-a956-4684-9c2b-a356acd77627 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.103958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbeeaa-f5da-4a67-9e9a-45f05c0ccd44 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.110874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f9f60-a956-4684-9c2b-a356acd77627 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.113824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbeeaa-f5da-4a67-9e9a-45f05c0ccd44 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.115514 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44437e1a-7446-4852-a96e-31b269f3adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.116163 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437e1a-7446-4852-a96e-31b269f3adf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.116445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437e1a-7446-4852-a96e-31b269f3adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.116721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437e1a-7446-4852-a96e-31b269f3adf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.117449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44437e1a-7446-4852-a96e-31b269f3adf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:43:44.117757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44437e1a-7446-4852-a96e-31b269f3adf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.118882 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f1244-1042-428d-8325-baa8bdda7a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.119655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44437e1a-7446-4852-a96e-31b269f3adf4 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.120020 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f1244-1042-428d-8325-baa8bdda7a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.120323 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f1244-1042-428d-8325-baa8bdda7a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.120599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f1244-1042-428d-8325-baa8bdda7a38 admin admin] PATH_INFO: `/v3/projects/988a033c10374016b569089ebb74d6b6/users/170beae008844abc8cc51ed8d5ca3c27/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.131618 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1295/2601] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:43:44.135876 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44437e1a-7446-4852-a96e-31b269f3adf4 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.136050 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f1244-1042-428d-8325-baa8bdda7a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988a033c10374016b569089ebb74d6b6, user_id=170beae008844abc8cc51ed8d5ca3c27, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.138839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f1244-1042-428d-8325-baa8bdda7a38 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.145415 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44437e1a-7446-4852-a96e-31b269f3adf4 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.150270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2bbee-9a23-4480-aa94-4f0ac42e9f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.150912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2bbee-9a23-4480-aa94-4f0ac42e9f94 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.151233 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2bbee-9a23-4480-aa94-4f0ac42e9f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.151527 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2bbee-9a23-4480-aa94-4f0ac42e9f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.152226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2bbee-9a23-4480-aa94-4f0ac42e9f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.153005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1307/2602] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:44 2022] PUT /identity/v3/projects/988a033c10374016b569089ebb74d6b6/users/170beae008844abc8cc51ed8d5ca3c27/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:43:44.156476 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2bbee-9a23-4480-aa94-4f0ac42e9f94 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.157425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f1244-1042-428d-8325-baa8bdda7a38 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.181387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1296/2603] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:43:44 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:43:44.185329 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2bbee-9a23-4480-aa94-4f0ac42e9f94 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.218253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f1244-1042-428d-8325-baa8bdda7a38 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.245293 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2bbee-9a23-4480-aa94-4f0ac42e9f94 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.250265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cfd6a-ffaf-48f2-a5fe-8f6523a2e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.250943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cfd6a-ffaf-48f2-a5fe-8f6523a2e852 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.251255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cfd6a-ffaf-48f2-a5fe-8f6523a2e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.251538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cfd6a-ffaf-48f2-a5fe-8f6523a2e852 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.252234 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cfd6a-ffaf-48f2-a5fe-8f6523a2e852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.254194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cfd6a-ffaf-48f2-a5fe-8f6523a2e852 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.272612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821199e-d841-4d19-9851-09529404df75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.273275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821199e-d841-4d19-9851-09529404df75 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.273575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821199e-d841-4d19-9851-09529404df75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.273829 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821199e-d841-4d19-9851-09529404df75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.277136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1297/2604] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:43:44 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:43:44.277274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821199e-d841-4d19-9851-09529404df75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.277274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821199e-d841-4d19-9851-09529404df75 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.278136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cfd6a-ffaf-48f2-a5fe-8f6523a2e852 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.286677 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1308/2605] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:43:44.290550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821199e-d841-4d19-9851-09529404df75 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.291451 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cfd6a-ffaf-48f2-a5fe-8f6523a2e852 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.296642 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373222f8-8c0c-4c74-b8ee-99346a83699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.297298 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373222f8-8c0c-4c74-b8ee-99346a83699a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.297578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373222f8-8c0c-4c74-b8ee-99346a83699a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.297851 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373222f8-8c0c-4c74-b8ee-99346a83699a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.298633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373222f8-8c0c-4c74-b8ee-99346a83699a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.300366 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373222f8-8c0c-4c74-b8ee-99346a83699a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.300783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821199e-d841-4d19-9851-09529404df75 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.306012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c5873-0943-4c4a-9669-7dfb9c2fc8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.307054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c5873-0943-4c4a-9669-7dfb9c2fc8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.307354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c5873-0943-4c4a-9669-7dfb9c2fc8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.307633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c5873-0943-4c4a-9669-7dfb9c2fc8a7 admin admin] PATH_INFO: `/v3/projects/988a033c10374016b569089ebb74d6b6/users/170beae008844abc8cc51ed8d5ca3c27/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.309940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c5873-0943-4c4a-9669-7dfb9c2fc8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988a033c10374016b569089ebb74d6b6, user_id=170beae008844abc8cc51ed8d5ca3c27, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.310427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1298/2606] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:43:44.312863 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c5873-0943-4c4a-9669-7dfb9c2fc8a7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.314285 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373222f8-8c0c-4c74-b8ee-99346a83699a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.323419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1309/2607] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:44 2022] PUT /identity/v3/projects/988a033c10374016b569089ebb74d6b6/users/170beae008844abc8cc51ed8d5ca3c27/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:43:44.326884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373222f8-8c0c-4c74-b8ee-99346a83699a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.383423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed070d4-7534-48f8-a46b-20861ee73ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.384111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed070d4-7534-48f8-a46b-20861ee73ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.384399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed070d4-7534-48f8-a46b-20861ee73ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.384678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed070d4-7534-48f8-a46b-20861ee73ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.385413 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed070d4-7534-48f8-a46b-20861ee73ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.387045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed070d4-7534-48f8-a46b-20861ee73ab5 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.398086 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1299/2608] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:43:44.402448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c5873-0943-4c4a-9669-7dfb9c2fc8a7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.414275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c5873-0943-4c4a-9669-7dfb9c2fc8a7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.420032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57382f-5afb-456e-935f-08eacf643ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.421658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57382f-5afb-456e-935f-08eacf643ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.421990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57382f-5afb-456e-935f-08eacf643ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.422315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57382f-5afb-456e-935f-08eacf643ac7 admin admin] PATH_INFO: `/v3/projects/2ee7f4c7290644ce862aed31581aef09/users/308d0611d3a345c9bc1a02a00c6aeb99/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.437616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57382f-5afb-456e-935f-08eacf643ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee7f4c7290644ce862aed31581aef09, user_id=308d0611d3a345c9bc1a02a00c6aeb99, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.440561 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57382f-5afb-456e-935f-08eacf643ac7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.453390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1310/2609] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:44 2022] PUT /identity/v3/projects/2ee7f4c7290644ce862aed31581aef09/users/308d0611d3a345c9bc1a02a00c6aeb99/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:44.464434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa99a-64fc-4b1f-9adf-c2bd1b7310de None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.464929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa99a-64fc-4b1f-9adf-c2bd1b7310de None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.465026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa99a-64fc-4b1f-9adf-c2bd1b7310de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.502711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c3afa99a-64fc-4b1f-9adf-c2bd1b7310de None None] MFA Rules not processed for user `308d0611d3a345c9bc1a02a00c6aeb99`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:44.505076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c3afa99a-64fc-4b1f-9adf-c2bd1b7310de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:44.577983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1300/2610] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:44.588752 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57382f-5afb-456e-935f-08eacf643ac7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:44.590491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4e57382f-5afb-456e-935f-08eacf643ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:44.647940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57382f-5afb-456e-935f-08eacf643ac7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:44.651775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a80557-8fe6-4580-bf82-3fe880bedfb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:44.652417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a80557-8fe6-4580-bf82-3fe880bedfb2 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:44.652692 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a80557-8fe6-4580-bf82-3fe880bedfb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:44.652964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a80557-8fe6-4580-bf82-3fe880bedfb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:44.662367 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a80557-8fe6-4580-bf82-3fe880bedfb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:44.663894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a80557-8fe6-4580-bf82-3fe880bedfb2 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:44.673544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1311/2611] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:45.045372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4e17-5739-4c18-b879-e6a7f1a098d5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:45.046250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4e17-5739-4c18-b879-e6a7f1a098d5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:45.046534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4e17-5739-4c18-b879-e6a7f1a098d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:45.071931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c96d4e17-5739-4c18-b879-e6a7f1a098d5 None None] MFA Rules not processed for user `170beae008844abc8cc51ed8d5ca3c27`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:45.073147 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c96d4e17-5739-4c18-b879-e6a7f1a098d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:45.143490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1301/2612] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:45.156004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a80557-8fe6-4580-bf82-3fe880bedfb2 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:45.164536 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a80557-8fe6-4580-bf82-3fe880bedfb2 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:45.168215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b802-ad46-4e83-b40a-dc53e0cd9e4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:45.168844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b802-ad46-4e83-b40a-dc53e0cd9e4e service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:45.169130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b802-ad46-4e83-b40a-dc53e0cd9e4e service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:45.169408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5b802-ad46-4e83-b40a-dc53e0cd9e4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:45.171794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-24b5b802-ad46-4e83-b40a-dc53e0cd9e4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:45.235869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5b802-ad46-4e83-b40a-dc53e0cd9e4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:45.236078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5b802-ad46-4e83-b40a-dc53e0cd9e4e service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:45.246447 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1312/2613] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:46.578184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d4e17-5739-4c18-b879-e6a7f1a098d5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:46.579638 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c96d4e17-5739-4c18-b879-e6a7f1a098d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:46.591264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d4e17-5739-4c18-b879-e6a7f1a098d5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:46.595335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323357-845b-4d53-91d2-8c03f7f9ca56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:46.595974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323357-845b-4d53-91d2-8c03f7f9ca56 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:46.596255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323357-845b-4d53-91d2-8c03f7f9ca56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:46.596531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323357-845b-4d53-91d2-8c03f7f9ca56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:46.606934 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa323357-845b-4d53-91d2-8c03f7f9ca56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:46.609363 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa323357-845b-4d53-91d2-8c03f7f9ca56 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:46.618759 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1302/2614] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:52.228427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b802-ad46-4e83-b40a-dc53e0cd9e4e service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:52.229864 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-24b5b802-ad46-4e83-b40a-dc53e0cd9e4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:52.286986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5b802-ad46-4e83-b40a-dc53e0cd9e4e service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:52.290558 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e56af-df6d-46ef-9ac5-73a1656a32ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:52.291228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e56af-df6d-46ef-9ac5-73a1656a32ac service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:52.291508 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e56af-df6d-46ef-9ac5-73a1656a32ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:52.291781 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e56af-df6d-46ef-9ac5-73a1656a32ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:52.293522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-709e56af-df6d-46ef-9ac5-73a1656a32ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:52.373243 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e56af-df6d-46ef-9ac5-73a1656a32ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:52.375418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e56af-df6d-46ef-9ac5-73a1656a32ac service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:52.395001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1313/2615] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:53.022890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323357-845b-4d53-91d2-8c03f7f9ca56 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:53.098955 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323357-845b-4d53-91d2-8c03f7f9ca56 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:53.104788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:53.107403 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:53.107886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:53.108252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] PATH_INFO: `/v3/users/308d0611d3a345c9bc1a02a00c6aeb99` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:53.109584 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308d0611d3a345c9bc1a02a00c6aeb99)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:53.114313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:53.206089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308d0611d3a345c9bc1a02a00c6aeb99'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:53.206905 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308d0611d3a345c9bc1a02a00c6aeb99'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:53.224371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308d0611d3a345c9bc1a02a00c6aeb99'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:53.226873 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308d0611d3a345c9bc1a02a00c6aeb99'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:53.242211 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308d0611d3a345c9bc1a02a00c6aeb99'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:53.282178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1303/2616] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:43:53 2022] DELETE /identity/v3/users/308d0611d3a345c9bc1a02a00c6aeb99 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:53.283767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2fdcf-15aa-4211-bdf0-28df78eff9e0 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:53.284244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2fdcf-15aa-4211-bdf0-28df78eff9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:53.284334 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2fdcf-15aa-4211-bdf0-28df78eff9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:53.302587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-03a2fdcf-15aa-4211-bdf0-28df78eff9e0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:53.303928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-03a2fdcf-15aa-4211-bdf0-28df78eff9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:53.381593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1314/2617] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:53.387013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:53.388724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:53.467769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f14860-43e3-49a0-b3ea-f7ea1dfc0f69 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:53.476305 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11d66d-4619-4dcc-9504-8f9808393bf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:53.477070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11d66d-4619-4dcc-9504-8f9808393bf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:53.477434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11d66d-4619-4dcc-9504-8f9808393bf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:53.477647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11d66d-4619-4dcc-9504-8f9808393bf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:53.488595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11d66d-4619-4dcc-9504-8f9808393bf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:53.490100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11d66d-4619-4dcc-9504-8f9808393bf0 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:53.525853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1304/2618] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:53.827952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2fdcf-15aa-4211-bdf0-28df78eff9e0 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:53.829499 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-03a2fdcf-15aa-4211-bdf0-28df78eff9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:53.842138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2fdcf-15aa-4211-bdf0-28df78eff9e0 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:53.847276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:53.848388 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:53.848958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:53.849457 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] PATH_INFO: `/v3/projects/2ee7f4c7290644ce862aed31581aef09` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:53.850912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee7f4c7290644ce862aed31581aef09)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:53.853530 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:53.908882 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee7f4c7290644ce862aed31581aef09', 'request_id': 'req-6559d11e-0ca3-49f2-a67a-2955d130b8c7'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:53.916108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee7f4c7290644ce862aed31581aef09', 'request_id': 'req-6559d11e-0ca3-49f2-a67a-2955d130b8c7'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:53.922317 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee7f4c7290644ce862aed31581aef09', 'request_id': 'req-6559d11e-0ca3-49f2-a67a-2955d130b8c7'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:53.933886 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] The token cache is being invalidate because project 2ee7f4c7290644ce862aed31581aef09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:43:53.934371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:53.935077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-6559d11e-0ca3-49f2-a67a-2955d130b8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:43:53.937432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1315/2619] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:43:53 2022] DELETE /identity/v3/projects/2ee7f4c7290644ce862aed31581aef09 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:53.942309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081a4a-5192-40a4-81b2-4d49d5b5f2e0 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:53.942603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081a4a-5192-40a4-81b2-4d49d5b5f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:53.942892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081a4a-5192-40a4-81b2-4d49d5b5f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:53.962294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-91081a4a-5192-40a4-81b2-4d49d5b5f2e0 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:53.963625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-91081a4a-5192-40a4-81b2-4d49d5b5f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:54.025161 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1305/2620] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:54.032867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3c8c7-da4b-40e3-8c10-4e4def381628 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.033151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3c8c7-da4b-40e3-8c10-4e4def381628 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.033425 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3c8c7-da4b-40e3-8c10-4e4def381628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.051563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-5eb3c8c7-da4b-40e3-8c10-4e4def381628 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:54.053636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5eb3c8c7-da4b-40e3-8c10-4e4def381628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:54.066178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1316/2621] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:54.067425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91081a4a-5192-40a4-81b2-4d49d5b5f2e0 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.078497 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91081a4a-5192-40a4-81b2-4d49d5b5f2e0 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.083294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c0258-c815-4b52-81fd-a51e499a5549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.084033 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c0258-c815-4b52-81fd-a51e499a5549 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.084406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c0258-c815-4b52-81fd-a51e499a5549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.084754 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c0258-c815-4b52-81fd-a51e499a5549 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.085561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c0258-c815-4b52-81fd-a51e499a5549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:43:54.085941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c0258-c815-4b52-81fd-a51e499a5549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.087650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c0258-c815-4b52-81fd-a51e499a5549 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.102464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1306/2622] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:43:54.103973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3c8c7-da4b-40e3-8c10-4e4def381628 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.113285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3c8c7-da4b-40e3-8c10-4e4def381628 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.118004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72337e47-50a2-41d8-93a1-a365e29ebb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.118667 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337e47-50a2-41d8-93a1-a365e29ebb8f admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.119233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337e47-50a2-41d8-93a1-a365e29ebb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.119512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337e47-50a2-41d8-93a1-a365e29ebb8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.120212 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72337e47-50a2-41d8-93a1-a365e29ebb8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.122130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72337e47-50a2-41d8-93a1-a365e29ebb8f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.152586 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1317/2623] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:43:54 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:54.153724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c0258-c815-4b52-81fd-a51e499a5549 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.163733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c0258-c815-4b52-81fd-a51e499a5549 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.222069 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce149ea1-dcc5-4931-9a23-f1134d412723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.222863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149ea1-dcc5-4931-9a23-f1134d412723 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.223309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149ea1-dcc5-4931-9a23-f1134d412723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.223659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce149ea1-dcc5-4931-9a23-f1134d412723 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.224436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce149ea1-dcc5-4931-9a23-f1134d412723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.226412 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce149ea1-dcc5-4931-9a23-f1134d412723 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.248210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1307/2624] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:43:54 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:54.252952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72337e47-50a2-41d8-93a1-a365e29ebb8f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.265275 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72337e47-50a2-41d8-93a1-a365e29ebb8f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.270340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4b1f-0c6d-4c70-a797-4d12b4ef83c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.271242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4b1f-0c6d-4c70-a797-4d12b4ef83c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.271531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4b1f-0c6d-4c70-a797-4d12b4ef83c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.271808 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc4b1f-0c6d-4c70-a797-4d12b4ef83c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.272685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc4b1f-0c6d-4c70-a797-4d12b4ef83c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.274368 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc4b1f-0c6d-4c70-a797-4d12b4ef83c1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.286960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1318/2625] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:54.290985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce149ea1-dcc5-4931-9a23-f1134d412723 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.301455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce149ea1-dcc5-4931-9a23-f1134d412723 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.307264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f984ea-6988-4f03-a097-b250160a1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.308004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f984ea-6988-4f03-a097-b250160a1e1a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.308295 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f984ea-6988-4f03-a097-b250160a1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.308576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f984ea-6988-4f03-a097-b250160a1e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.309324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f984ea-6988-4f03-a097-b250160a1e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.310947 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f984ea-6988-4f03-a097-b250160a1e1a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.324518 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1308/2626] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:54.328311 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4b1f-0c6d-4c70-a797-4d12b4ef83c1 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.338621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc4b1f-0c6d-4c70-a797-4d12b4ef83c1 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.343691 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd96a0-99cd-4fc7-8fcf-12e564638640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.345059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd96a0-99cd-4fc7-8fcf-12e564638640 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.345345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd96a0-99cd-4fc7-8fcf-12e564638640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.345620 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd96a0-99cd-4fc7-8fcf-12e564638640 admin admin] PATH_INFO: `/v3/projects/e40612c8062745b7a29344ec66f2e951/users/42b01c4320e94d57aafce79c43d1c7e5/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.363163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd96a0-99cd-4fc7-8fcf-12e564638640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40612c8062745b7a29344ec66f2e951, user_id=42b01c4320e94d57aafce79c43d1c7e5, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.366075 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd96a0-99cd-4fc7-8fcf-12e564638640 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.381029 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1319/2627] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:54 2022] PUT /identity/v3/projects/e40612c8062745b7a29344ec66f2e951/users/42b01c4320e94d57aafce79c43d1c7e5/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:54.394072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89e4f-e747-4200-af33-f502b60ac34c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.394367 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89e4f-e747-4200-af33-f502b60ac34c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.394653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f89e4f-e747-4200-af33-f502b60ac34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.425238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-19f89e4f-e747-4200-af33-f502b60ac34c None None] MFA Rules not processed for user `42b01c4320e94d57aafce79c43d1c7e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:54.426596 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-19f89e4f-e747-4200-af33-f502b60ac34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:54.495796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1309/2628] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:54.501016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd96a0-99cd-4fc7-8fcf-12e564638640 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.581541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd96a0-99cd-4fc7-8fcf-12e564638640 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.586467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f7d47-a866-4b52-b3b0-bb44be9899b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.587203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f7d47-a866-4b52-b3b0-bb44be9899b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.587490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f7d47-a866-4b52-b3b0-bb44be9899b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.587767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f7d47-a866-4b52-b3b0-bb44be9899b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.588473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f7d47-a866-4b52-b3b0-bb44be9899b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.590446 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f7d47-a866-4b52-b3b0-bb44be9899b0 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.616893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1320/2629] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:43:54 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:43:54.621144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f89e4f-e747-4200-af33-f502b60ac34c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.631883 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f89e4f-e747-4200-af33-f502b60ac34c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.687822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273dbf8-b20f-4e3a-9702-cf1cbbec5b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.688412 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273dbf8-b20f-4e3a-9702-cf1cbbec5b01 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.688698 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273dbf8-b20f-4e3a-9702-cf1cbbec5b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.688977 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273dbf8-b20f-4e3a-9702-cf1cbbec5b01 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.689670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273dbf8-b20f-4e3a-9702-cf1cbbec5b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.691619 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273dbf8-b20f-4e3a-9702-cf1cbbec5b01 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.712861 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1310/2630] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:43:54 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:43:54.716905 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f7d47-a866-4b52-b3b0-bb44be9899b0 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.727238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f7d47-a866-4b52-b3b0-bb44be9899b0 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.732044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0534e2-2647-48ab-8de5-367f11bba17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.732700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0534e2-2647-48ab-8de5-367f11bba17a admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.733077 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0534e2-2647-48ab-8de5-367f11bba17a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.733360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0534e2-2647-48ab-8de5-367f11bba17a admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.734090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0534e2-2647-48ab-8de5-367f11bba17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.735753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0534e2-2647-48ab-8de5-367f11bba17a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.746775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1321/2631] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:54.751831 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273dbf8-b20f-4e3a-9702-cf1cbbec5b01 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.762255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273dbf8-b20f-4e3a-9702-cf1cbbec5b01 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.768002 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2436cc-b51d-4328-ae20-0c391185c096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.768889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2436cc-b51d-4328-ae20-0c391185c096 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.769197 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2436cc-b51d-4328-ae20-0c391185c096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.769450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2436cc-b51d-4328-ae20-0c391185c096 admin admin] PATH_INFO: `/v3/projects/221fbb4d258241b69db0997be09b9025/users/612c205338d84007add4408027ee69dd/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.784684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2436cc-b51d-4328-ae20-0c391185c096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221fbb4d258241b69db0997be09b9025, user_id=612c205338d84007add4408027ee69dd, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.787424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2436cc-b51d-4328-ae20-0c391185c096 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.802042 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1311/2632] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:54 2022] PUT /identity/v3/projects/221fbb4d258241b69db0997be09b9025/users/612c205338d84007add4408027ee69dd/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:43:54.806331 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0534e2-2647-48ab-8de5-367f11bba17a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.818700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0534e2-2647-48ab-8de5-367f11bba17a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.876107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30a3ee-f894-4e86-b371-2c598058a5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.876999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a3ee-f894-4e86-b371-2c598058a5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.877284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a3ee-f894-4e86-b371-2c598058a5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.877559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a3ee-f894-4e86-b371-2c598058a5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.878290 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30a3ee-f894-4e86-b371-2c598058a5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.880044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30a3ee-f894-4e86-b371-2c598058a5d0 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.891169 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1322/2633] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:43:54.895640 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2436cc-b51d-4328-ae20-0c391185c096 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:54.906479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2436cc-b51d-4328-ae20-0c391185c096 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:54.911351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10583c96-00d2-41c1-b72b-9369c12f9fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:54.912306 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10583c96-00d2-41c1-b72b-9369c12f9fba admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.912695 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10583c96-00d2-41c1-b72b-9369c12f9fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.913189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10583c96-00d2-41c1-b72b-9369c12f9fba admin admin] PATH_INFO: `/v3/projects/221fbb4d258241b69db0997be09b9025/users/612c205338d84007add4408027ee69dd/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.915391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10583c96-00d2-41c1-b72b-9369c12f9fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=221fbb4d258241b69db0997be09b9025, user_id=612c205338d84007add4408027ee69dd, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:54.918068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10583c96-00d2-41c1-b72b-9369c12f9fba admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:54.928668 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1312/2634] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:43:54 2022] PUT /identity/v3/projects/221fbb4d258241b69db0997be09b9025/users/612c205338d84007add4408027ee69dd/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:43:54.941071 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed02c-6ea1-488a-b1be-9f33c457e405 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:54.941310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed02c-6ea1-488a-b1be-9f33c457e405 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:54.941589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eed02c-6ea1-488a-b1be-9f33c457e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:54.969390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f7eed02c-6ea1-488a-b1be-9f33c457e405 None None] MFA Rules not processed for user `612c205338d84007add4408027ee69dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:43:54.970609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f7eed02c-6ea1-488a-b1be-9f33c457e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:55.040217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1323/2635] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:43:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:43:55.051371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10583c96-00d2-41c1-b72b-9369c12f9fba admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:55.053044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-10583c96-00d2-41c1-b72b-9369c12f9fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:43:55.107210 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10583c96-00d2-41c1-b72b-9369c12f9fba admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:55.111360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe4c5a-eeeb-4a57-a2bb-4785cae1a4b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:55.111990 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe4c5a-eeeb-4a57-a2bb-4785cae1a4b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:55.112268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe4c5a-eeeb-4a57-a2bb-4785cae1a4b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:55.112539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe4c5a-eeeb-4a57-a2bb-4785cae1a4b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:55.169626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe4c5a-eeeb-4a57-a2bb-4785cae1a4b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:55.171665 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe4c5a-eeeb-4a57-a2bb-4785cae1a4b4 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:55.180352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1313/2636] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:43:59.315783 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eed02c-6ea1-488a-b1be-9f33c457e405 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:43:59.335347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eed02c-6ea1-488a-b1be-9f33c457e405 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:43:59.339310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b470f52-c233-487c-8533-bb7f9b99fc89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:43:59.340140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b470f52-c233-487c-8533-bb7f9b99fc89 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:43:59.340479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b470f52-c233-487c-8533-bb7f9b99fc89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:43:59.340757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b470f52-c233-487c-8533-bb7f9b99fc89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:43:59.350648 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b470f52-c233-487c-8533-bb7f9b99fc89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:43:59.352129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b470f52-c233-487c-8533-bb7f9b99fc89 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:43:59.361504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1324/2637] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:43:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:01.874944 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe4c5a-eeeb-4a57-a2bb-4785cae1a4b4 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:01.876582 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-98fe4c5a-eeeb-4a57-a2bb-4785cae1a4b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:01.956371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe4c5a-eeeb-4a57-a2bb-4785cae1a4b4 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:01.970726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:01.971641 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:01.971922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:01.972278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] PATH_INFO: `/v3/users/f2961ecee6494edaa40d65cdcedaf4e2` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:01.973450 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2961ecee6494edaa40d65cdcedaf4e2)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:01.975436 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:02.051553 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2961ecee6494edaa40d65cdcedaf4e2'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.052570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2961ecee6494edaa40d65cdcedaf4e2'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.061006 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2961ecee6494edaa40d65cdcedaf4e2'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.062478 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2961ecee6494edaa40d65cdcedaf4e2'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.071242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2961ecee6494edaa40d65cdcedaf4e2'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.096554 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1314/2638] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:01 2022] DELETE /identity/v3/users/f2961ecee6494edaa40d65cdcedaf4e2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:02.330156 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b470f52-c233-487c-8533-bb7f9b99fc89 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:02.344466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b470f52-c233-487c-8533-bb7f9b99fc89 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:02.412070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:02.413061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:02.413352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:02.413632 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] PATH_INFO: `/v3/projects/2adbab81a29f4d5a83408a58c3ca6f38` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:02.414884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2adbab81a29f4d5a83408a58c3ca6f38)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:02.416959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:02.471146 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2adbab81a29f4d5a83408a58c3ca6f38', 'request_id': 'req-09e648e7-166c-460e-b3d5-4104bcbbb7d9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.481041 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2adbab81a29f4d5a83408a58c3ca6f38', 'request_id': 'req-09e648e7-166c-460e-b3d5-4104bcbbb7d9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.490456 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2adbab81a29f4d5a83408a58c3ca6f38', 'request_id': 'req-09e648e7-166c-460e-b3d5-4104bcbbb7d9'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.504382 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] The token cache is being invalidate because project 2adbab81a29f4d5a83408a58c3ca6f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:02.504700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.505354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.506909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1325/2639] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:02 2022] DELETE /identity/v3/projects/2adbab81a29f4d5a83408a58c3ca6f38 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:02.510951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:02.512384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:02.526459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e34fd-6dce-4e06-a9e3-489f1a951100 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:02.584826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:02.585702 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:02.585988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:02.586267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] PATH_INFO: `/v3/users/170beae008844abc8cc51ed8d5ca3c27` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:02.587580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=170beae008844abc8cc51ed8d5ca3c27)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:02.590000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:02.641942 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170beae008844abc8cc51ed8d5ca3c27'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.642630 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170beae008844abc8cc51ed8d5ca3c27'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.651248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170beae008844abc8cc51ed8d5ca3c27'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.652337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170beae008844abc8cc51ed8d5ca3c27'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.663183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-b51eb8cb-83e1-4777-8c2b-c3f0f3805345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170beae008844abc8cc51ed8d5ca3c27'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:02.682879 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1315/2640] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:02 2022] DELETE /identity/v3/users/170beae008844abc8cc51ed8d5ca3c27 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:02.858085 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:02.859593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:02.873884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e648e7-166c-460e-b3d5-4104bcbbb7d9 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:02.945733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:02.946656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:02.947096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:02.947630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] PATH_INFO: `/v3/projects/988a033c10374016b569089ebb74d6b6` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:02.949164 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] RBAC: Authorizing `identity:delete_project(project_id=988a033c10374016b569089ebb74d6b6)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:02.951351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.006506 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988a033c10374016b569089ebb74d6b6', 'request_id': 'req-2054ed40-53d2-44a7-8831-e5c16ab2aafd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:03.016076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988a033c10374016b569089ebb74d6b6', 'request_id': 'req-2054ed40-53d2-44a7-8831-e5c16ab2aafd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:03.021678 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988a033c10374016b569089ebb74d6b6', 'request_id': 'req-2054ed40-53d2-44a7-8831-e5c16ab2aafd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:03.032930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] The token cache is being invalidate because project 988a033c10374016b569089ebb74d6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:03.033278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:03.033947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-2054ed40-53d2-44a7-8831-e5c16ab2aafd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:03.035634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1326/2641] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:02 2022] DELETE /identity/v3/projects/988a033c10374016b569089ebb74d6b6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:03.040536 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af29108-0669-4af9-ba8f-6e9c2f228e4a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.041588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af29108-0669-4af9-ba8f-6e9c2f228e4a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.041588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af29108-0669-4af9-ba8f-6e9c2f228e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.080574 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-6af29108-0669-4af9-ba8f-6e9c2f228e4a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:03.081886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6af29108-0669-4af9-ba8f-6e9c2f228e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:03.141375 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1316/2642] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:03.149347 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7cf1-b196-4c78-9171-206b5884c755 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.149729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7cf1-b196-4c78-9171-206b5884c755 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.150081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b7cf1-b196-4c78-9171-206b5884c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.168550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6a7b7cf1-b196-4c78-9171-206b5884c755 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:03.169758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6a7b7cf1-b196-4c78-9171-206b5884c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:03.177745 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1327/2643] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:03.182068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af29108-0669-4af9-ba8f-6e9c2f228e4a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.192776 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af29108-0669-4af9-ba8f-6e9c2f228e4a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:03.197962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9d77-a564-4529-b8ba-92d21d103f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:03.198158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9d77-a564-4529-b8ba-92d21d103f03 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.198429 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9d77-a564-4529-b8ba-92d21d103f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.198713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9d77-a564-4529-b8ba-92d21d103f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.199993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa9d77-a564-4529-b8ba-92d21d103f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:44:03.199993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa9d77-a564-4529-b8ba-92d21d103f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:03.201405 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa9d77-a564-4529-b8ba-92d21d103f03 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.219531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1317/2644] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:44:03.220616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b7cf1-b196-4c78-9171-206b5884c755 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.229875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b7cf1-b196-4c78-9171-206b5884c755 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:03.235073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72379e1e-78c6-4ccf-a664-e006f52c6966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:03.235861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72379e1e-78c6-4ccf-a664-e006f52c6966 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.236254 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72379e1e-78c6-4ccf-a664-e006f52c6966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.236554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72379e1e-78c6-4ccf-a664-e006f52c6966 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.237260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72379e1e-78c6-4ccf-a664-e006f52c6966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:03.239675 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72379e1e-78c6-4ccf-a664-e006f52c6966 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.285370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1328/2645] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:44:03 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:44:03.286378 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9d77-a564-4529-b8ba-92d21d103f03 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.299571 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9d77-a564-4529-b8ba-92d21d103f03 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:03.360092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef0741-cc40-482a-86d6-930238fad73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:03.360906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef0741-cc40-482a-86d6-930238fad73f admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.361075 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef0741-cc40-482a-86d6-930238fad73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.361342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef0741-cc40-482a-86d6-930238fad73f admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.362044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef0741-cc40-482a-86d6-930238fad73f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:03.364067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef0741-cc40-482a-86d6-930238fad73f admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.387502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1318/2646] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:44:03 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:03.391711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72379e1e-78c6-4ccf-a664-e006f52c6966 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.402327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72379e1e-78c6-4ccf-a664-e006f52c6966 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:03.408915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5238e-ab7d-4d00-bfb9-00ed9fe3df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:03.409587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5238e-ab7d-4d00-bfb9-00ed9fe3df0c admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.409869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5238e-ab7d-4d00-bfb9-00ed9fe3df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.410147 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5238e-ab7d-4d00-bfb9-00ed9fe3df0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.410889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5238e-ab7d-4d00-bfb9-00ed9fe3df0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:03.412537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5238e-ab7d-4d00-bfb9-00ed9fe3df0c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.424983 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1329/2647] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:44:03.429498 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef0741-cc40-482a-86d6-930238fad73f admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.441322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef0741-cc40-482a-86d6-930238fad73f admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:03.446106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e96b69-c32c-4ff7-92f7-f5a5c18fce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:03.446808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96b69-c32c-4ff7-92f7-f5a5c18fce7e admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.447135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96b69-c32c-4ff7-92f7-f5a5c18fce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.447420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e96b69-c32c-4ff7-92f7-f5a5c18fce7e admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.450521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96b69-c32c-4ff7-92f7-f5a5c18fce7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:03.450521 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e96b69-c32c-4ff7-92f7-f5a5c18fce7e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.461716 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1319/2648] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:44:03.465649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5238e-ab7d-4d00-bfb9-00ed9fe3df0c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.475703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5238e-ab7d-4d00-bfb9-00ed9fe3df0c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:03.480399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5a3a9-d430-4827-8c3a-443d3f5f6866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:03.481370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a3a9-d430-4827-8c3a-443d3f5f6866 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.481665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a3a9-d430-4827-8c3a-443d3f5f6866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.481944 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5a3a9-d430-4827-8c3a-443d3f5f6866 admin admin] PATH_INFO: `/v3/projects/61eb72af1a674170bd750135233854c5/users/f2fab376044f4d1a9f54f98db3a5d18b/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.497435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5a3a9-d430-4827-8c3a-443d3f5f6866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61eb72af1a674170bd750135233854c5, user_id=f2fab376044f4d1a9f54f98db3a5d18b, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:03.500784 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5a3a9-d430-4827-8c3a-443d3f5f6866 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.515370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1330/2649] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:44:03 2022] PUT /identity/v3/projects/61eb72af1a674170bd750135233854c5/users/f2fab376044f4d1a9f54f98db3a5d18b/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:03.526727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccedb2-f4a6-412c-a147-d5af36f7efe5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.527051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccedb2-f4a6-412c-a147-d5af36f7efe5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.527375 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccedb2-f4a6-412c-a147-d5af36f7efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.560924 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-54ccedb2-f4a6-412c-a147-d5af36f7efe5 None None] MFA Rules not processed for user `f2fab376044f4d1a9f54f98db3a5d18b`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:03.562742 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-54ccedb2-f4a6-412c-a147-d5af36f7efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:03.640906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1320/2650] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:03.645436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5a3a9-d430-4827-8c3a-443d3f5f6866 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.715441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5a3a9-d430-4827-8c3a-443d3f5f6866 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:03.721130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8178e2-227a-4a53-a1df-373f73bcd2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:03.721808 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8178e2-227a-4a53-a1df-373f73bcd2bb admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.722096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8178e2-227a-4a53-a1df-373f73bcd2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.722371 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8178e2-227a-4a53-a1df-373f73bcd2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.723090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8178e2-227a-4a53-a1df-373f73bcd2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:03.725006 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8178e2-227a-4a53-a1df-373f73bcd2bb admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.754485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1331/2651] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:44:03 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:03.756002 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccedb2-f4a6-412c-a147-d5af36f7efe5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.766555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ccedb2-f4a6-412c-a147-d5af36f7efe5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:03.820682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca31f0-f895-46b1-9766-d4d3fb7b64b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:03.821383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca31f0-f895-46b1-9766-d4d3fb7b64b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.821714 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca31f0-f895-46b1-9766-d4d3fb7b64b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.821950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca31f0-f895-46b1-9766-d4d3fb7b64b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.822646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca31f0-f895-46b1-9766-d4d3fb7b64b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:03.824646 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca31f0-f895-46b1-9766-d4d3fb7b64b9 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.853557 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1321/2652] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:44:03 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:44:03.854763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8178e2-227a-4a53-a1df-373f73bcd2bb admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.865584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8178e2-227a-4a53-a1df-373f73bcd2bb admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:03.870360 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d1265-8b54-4a72-a287-1039bd491cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:03.871009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d1265-8b54-4a72-a287-1039bd491cba admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.871320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d1265-8b54-4a72-a287-1039bd491cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.871597 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d1265-8b54-4a72-a287-1039bd491cba admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.872324 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d1265-8b54-4a72-a287-1039bd491cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:03.873922 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d1265-8b54-4a72-a287-1039bd491cba admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.884048 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1332/2653] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:44:03.888185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca31f0-f895-46b1-9766-d4d3fb7b64b9 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.897962 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca31f0-f895-46b1-9766-d4d3fb7b64b9 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:03.902823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37af792-39e6-4e26-b866-449994cdc3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:03.903738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af792-39e6-4e26-b866-449994cdc3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:03.904020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af792-39e6-4e26-b866-449994cdc3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:03.904297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37af792-39e6-4e26-b866-449994cdc3ad admin admin] PATH_INFO: `/v3/projects/a2b0a0e0b6ce4de2863452f00ffbee3a/users/ca38700af7254edbb078538547e7366e/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:03.919447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37af792-39e6-4e26-b866-449994cdc3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b0a0e0b6ce4de2863452f00ffbee3a, user_id=ca38700af7254edbb078538547e7366e, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:03.923621 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37af792-39e6-4e26-b866-449994cdc3ad admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:03.944072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1322/2654] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:44:03 2022] PUT /identity/v3/projects/a2b0a0e0b6ce4de2863452f00ffbee3a/users/ca38700af7254edbb078538547e7366e/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:03.945096 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d1265-8b54-4a72-a287-1039bd491cba admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:03.956963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d1265-8b54-4a72-a287-1039bd491cba admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:04.043982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2d518-5e76-4459-964c-565cb45410ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:04.044661 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2d518-5e76-4459-964c-565cb45410ac admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:04.044950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2d518-5e76-4459-964c-565cb45410ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:04.045226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2d518-5e76-4459-964c-565cb45410ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:04.045989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2d518-5e76-4459-964c-565cb45410ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:04.047896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2d518-5e76-4459-964c-565cb45410ac admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:04.061930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1333/2655] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:44:04.063226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37af792-39e6-4e26-b866-449994cdc3ad admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:04.073913 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37af792-39e6-4e26-b866-449994cdc3ad admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:04.079315 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380564c0-5cd6-4fbf-92ee-5e71c541d57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:04.080222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380564c0-5cd6-4fbf-92ee-5e71c541d57b admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:04.080508 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380564c0-5cd6-4fbf-92ee-5e71c541d57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:04.080786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380564c0-5cd6-4fbf-92ee-5e71c541d57b admin admin] PATH_INFO: `/v3/projects/a2b0a0e0b6ce4de2863452f00ffbee3a/users/ca38700af7254edbb078538547e7366e/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:04.082884 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380564c0-5cd6-4fbf-92ee-5e71c541d57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b0a0e0b6ce4de2863452f00ffbee3a, user_id=ca38700af7254edbb078538547e7366e, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:04.085558 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380564c0-5cd6-4fbf-92ee-5e71c541d57b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:04.097297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1323/2656] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:44:04 2022] PUT /identity/v3/projects/a2b0a0e0b6ce4de2863452f00ffbee3a/users/ca38700af7254edbb078538547e7366e/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:04.108059 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65fb3a-5722-433e-9578-66a565c87563 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:04.108348 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65fb3a-5722-433e-9578-66a565c87563 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:04.108627 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65fb3a-5722-433e-9578-66a565c87563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:04.135514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-4d65fb3a-5722-433e-9578-66a565c87563 None None] MFA Rules not processed for user `ca38700af7254edbb078538547e7366e`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:04.136733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4d65fb3a-5722-433e-9578-66a565c87563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:04.200865 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1334/2657] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:04.212000 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380564c0-5cd6-4fbf-92ee-5e71c541d57b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:04.213685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-380564c0-5cd6-4fbf-92ee-5e71c541d57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:04.279373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380564c0-5cd6-4fbf-92ee-5e71c541d57b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:04.283629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8c382-3f53-4f12-8e1d-079e43132815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:04.284263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8c382-3f53-4f12-8e1d-079e43132815 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:04.284545 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8c382-3f53-4f12-8e1d-079e43132815 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:04.284820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8c382-3f53-4f12-8e1d-079e43132815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:04.338875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8c382-3f53-4f12-8e1d-079e43132815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:04.339338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65fb3a-5722-433e-9578-66a565c87563 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:04.340372 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8c382-3f53-4f12-8e1d-079e43132815 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:04.340720 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-4d65fb3a-5722-433e-9578-66a565c87563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:04.350166 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1324/2658] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:04.411180 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65fb3a-5722-433e-9578-66a565c87563 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:04.416591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:04.417489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:04.417760 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:04.418253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] PATH_INFO: `/v3/users/42b01c4320e94d57aafce79c43d1c7e5` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:04.419293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b01c4320e94d57aafce79c43d1c7e5)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:04.421397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:04.473958 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b01c4320e94d57aafce79c43d1c7e5'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:04.484215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b01c4320e94d57aafce79c43d1c7e5'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:04.485260 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b01c4320e94d57aafce79c43d1c7e5'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:04.486063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b01c4320e94d57aafce79c43d1c7e5'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:04.500947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b01c4320e94d57aafce79c43d1c7e5'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:04.513424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1335/2659] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:04 2022] DELETE /identity/v3/users/42b01c4320e94d57aafce79c43d1c7e5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:44:04.518936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35b776-8f9a-4b0c-8ae3-d55d5b80a84e None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:04.519568 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35b776-8f9a-4b0c-8ae3-d55d5b80a84e None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:04.519850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35b776-8f9a-4b0c-8ae3-d55d5b80a84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:04.543774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-9b35b776-8f9a-4b0c-8ae3-d55d5b80a84e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:04.545524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9b35b776-8f9a-4b0c-8ae3-d55d5b80a84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:04.611647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1325/2660] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:04.622219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:04.624676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:04.690070 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c03d32-1505-41c2-950d-95f4d0f3a2cf admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:04.699176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a557f0-f877-4ccb-9cf5-29c20faa3c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:04.699877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a557f0-f877-4ccb-9cf5-29c20faa3c40 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:04.700229 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a557f0-f877-4ccb-9cf5-29c20faa3c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:04.700517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a557f0-f877-4ccb-9cf5-29c20faa3c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:04.711938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a557f0-f877-4ccb-9cf5-29c20faa3c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:04.714563 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a557f0-f877-4ccb-9cf5-29c20faa3c40 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:04.729354 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1336/2661] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:05.004288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35b776-8f9a-4b0c-8ae3-d55d5b80a84e None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:05.006120 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-9b35b776-8f9a-4b0c-8ae3-d55d5b80a84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:05.031953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35b776-8f9a-4b0c-8ae3-d55d5b80a84e None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:05.039597 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:05.040802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:05.041188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:05.041473 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] PATH_INFO: `/v3/projects/e40612c8062745b7a29344ec66f2e951` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:05.042681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40612c8062745b7a29344ec66f2e951)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:05.044724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:05.097519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40612c8062745b7a29344ec66f2e951', 'request_id': 'req-5d26b97e-6002-4087-ad69-1bcacab1d80d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.104250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40612c8062745b7a29344ec66f2e951', 'request_id': 'req-5d26b97e-6002-4087-ad69-1bcacab1d80d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.114049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40612c8062745b7a29344ec66f2e951', 'request_id': 'req-5d26b97e-6002-4087-ad69-1bcacab1d80d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.129522 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] The token cache is being invalidate because project e40612c8062745b7a29344ec66f2e951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:05.129808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.130526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.132201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1326/2662] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:05 2022] DELETE /identity/v3/projects/e40612c8062745b7a29344ec66f2e951 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:05.136246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a557f0-f877-4ccb-9cf5-29c20faa3c40 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:05.145798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a557f0-f877-4ccb-9cf5-29c20faa3c40 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:05.209701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:05.209701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:05.209701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:05.209701 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] PATH_INFO: `/v3/users/612c205338d84007add4408027ee69dd` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:05.211684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=612c205338d84007add4408027ee69dd)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:05.211684 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:05.259529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612c205338d84007add4408027ee69dd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.266422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612c205338d84007add4408027ee69dd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.267240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612c205338d84007add4408027ee69dd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.267756 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612c205338d84007add4408027ee69dd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.280837 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-10c99d9e-2800-4abe-9e9c-aa4b1135a880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612c205338d84007add4408027ee69dd'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.293303 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1337/2663] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:05 2022] DELETE /identity/v3/users/612c205338d84007add4408027ee69dd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:44:05.582214 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:05.583750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:05.597556 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26b97e-6002-4087-ad69-1bcacab1d80d admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:05.656680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:05.657622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:05.657999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:05.658316 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] PATH_INFO: `/v3/projects/221fbb4d258241b69db0997be09b9025` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:05.659932 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=221fbb4d258241b69db0997be09b9025)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:05.661878 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:05.710534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221fbb4d258241b69db0997be09b9025', 'request_id': 'req-946f4d9e-3877-4892-bd33-9aff2fd80d5e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.717967 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221fbb4d258241b69db0997be09b9025', 'request_id': 'req-946f4d9e-3877-4892-bd33-9aff2fd80d5e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.725661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221fbb4d258241b69db0997be09b9025', 'request_id': 'req-946f4d9e-3877-4892-bd33-9aff2fd80d5e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.738949 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] The token cache is being invalidate because project 221fbb4d258241b69db0997be09b9025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:05.739283 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.739938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-946f4d9e-3877-4892-bd33-9aff2fd80d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:05.742605 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1327/2664] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:05 2022] DELETE /identity/v3/projects/221fbb4d258241b69db0997be09b9025 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:05.749203 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c205fb-bc53-445c-99e3-32fe7bd06b6c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:05.749853 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c205fb-bc53-445c-99e3-32fe7bd06b6c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:05.749961 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c205fb-bc53-445c-99e3-32fe7bd06b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:05.768206 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-c7c205fb-bc53-445c-99e3-32fe7bd06b6c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:05.769423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c7c205fb-bc53-445c-99e3-32fe7bd06b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:05.832835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1338/2665] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:44:05.841335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411c8d-fd3a-4a7c-8324-98d430745bfc None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:05.841685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411c8d-fd3a-4a7c-8324-98d430745bfc None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:05.842064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f411c8d-fd3a-4a7c-8324-98d430745bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:05.862399 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-3f411c8d-fd3a-4a7c-8324-98d430745bfc None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:05.863758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-3f411c8d-fd3a-4a7c-8324-98d430745bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:05.872885 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1328/2666] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:05.877611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c205fb-bc53-445c-99e3-32fe7bd06b6c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:05.887887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c205fb-bc53-445c-99e3-32fe7bd06b6c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:05.892988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31cbb5-c13c-41ed-8260-c0ef2e8b8bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:05.893670 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31cbb5-c13c-41ed-8260-c0ef2e8b8bef admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:05.893955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31cbb5-c13c-41ed-8260-c0ef2e8b8bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:05.894233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31cbb5-c13c-41ed-8260-c0ef2e8b8bef admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:05.894959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31cbb5-c13c-41ed-8260-c0ef2e8b8bef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:44:05.895305 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31cbb5-c13c-41ed-8260-c0ef2e8b8bef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:05.896908 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31cbb5-c13c-41ed-8260-c0ef2e8b8bef admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:05.908645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1339/2667] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:44:05.912987 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f411c8d-fd3a-4a7c-8324-98d430745bfc None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:05.922088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f411c8d-fd3a-4a7c-8324-98d430745bfc None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:05.927008 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d4f8b-f0ce-42f5-9abe-14e2dd7a2e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:05.927691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d4f8b-f0ce-42f5-9abe-14e2dd7a2e7a admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:05.928088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d4f8b-f0ce-42f5-9abe-14e2dd7a2e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:05.928281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d4f8b-f0ce-42f5-9abe-14e2dd7a2e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:05.928969 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d4f8b-f0ce-42f5-9abe-14e2dd7a2e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:05.930906 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d4f8b-f0ce-42f5-9abe-14e2dd7a2e7a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:05.957113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1329/2668] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:44:05 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:44:05.961256 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31cbb5-c13c-41ed-8260-c0ef2e8b8bef admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:05.971399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31cbb5-c13c-41ed-8260-c0ef2e8b8bef admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:06.026690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6560a-8edd-412f-a980-7f2bd4b71eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:06.027412 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6560a-8edd-412f-a980-7f2bd4b71eaa admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.027694 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6560a-8edd-412f-a980-7f2bd4b71eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.027963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6560a-8edd-412f-a980-7f2bd4b71eaa admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.028653 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6560a-8edd-412f-a980-7f2bd4b71eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:06.030574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6560a-8edd-412f-a980-7f2bd4b71eaa admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:06.049099 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1340/2669] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:44:05 2022] POST /identity/v3/users => generated 280 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:06.053296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d4f8b-f0ce-42f5-9abe-14e2dd7a2e7a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:06.065398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d4f8b-f0ce-42f5-9abe-14e2dd7a2e7a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:06.070232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2fa3e-cba1-4863-ac20-56217460bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:06.070914 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2fa3e-cba1-4863-ac20-56217460bf34 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.071227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2fa3e-cba1-4863-ac20-56217460bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.071503 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2fa3e-cba1-4863-ac20-56217460bf34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.072226 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2fa3e-cba1-4863-ac20-56217460bf34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:06.073844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2fa3e-cba1-4863-ac20-56217460bf34 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:06.086323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1330/2670] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:44:06.090486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6560a-8edd-412f-a980-7f2bd4b71eaa admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:06.100704 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6560a-8edd-412f-a980-7f2bd4b71eaa admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:06.105335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58fcc-9369-4d03-99be-99e9e852f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:06.105980 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58fcc-9369-4d03-99be-99e9e852f966 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.106259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58fcc-9369-4d03-99be-99e9e852f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.106529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58fcc-9369-4d03-99be-99e9e852f966 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.107299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58fcc-9369-4d03-99be-99e9e852f966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:06.108899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58fcc-9369-4d03-99be-99e9e852f966 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:06.120470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1341/2671] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:44:06.125427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2fa3e-cba1-4863-ac20-56217460bf34 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:06.135877 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2fa3e-cba1-4863-ac20-56217460bf34 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:06.142136 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339e867-7420-4242-8792-440ba3c9b4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:06.143062 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e867-7420-4242-8792-440ba3c9b4c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.143494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e867-7420-4242-8792-440ba3c9b4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.143777 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e867-7420-4242-8792-440ba3c9b4c3 admin admin] PATH_INFO: `/v3/projects/0e4f476e6ad74c6a8b0b6f2481642b97/users/315dd15b36be46a5b78dac30071b1f5e/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.161198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339e867-7420-4242-8792-440ba3c9b4c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4f476e6ad74c6a8b0b6f2481642b97, user_id=315dd15b36be46a5b78dac30071b1f5e, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:06.164114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339e867-7420-4242-8792-440ba3c9b4c3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:06.179056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1331/2672] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:44:06 2022] PUT /identity/v3/projects/0e4f476e6ad74c6a8b0b6f2481642b97/users/315dd15b36be46a5b78dac30071b1f5e/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:06.190882 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22220b-afd9-4c3a-8405-d18ef45cd508 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.191213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22220b-afd9-4c3a-8405-d18ef45cd508 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.191497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22220b-afd9-4c3a-8405-d18ef45cd508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.217322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-1e22220b-afd9-4c3a-8405-d18ef45cd508 None None] MFA Rules not processed for user `315dd15b36be46a5b78dac30071b1f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:06.218532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1e22220b-afd9-4c3a-8405-d18ef45cd508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:06.279661 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1342/2673] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:06 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:06.309972 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339e867-7420-4242-8792-440ba3c9b4c3 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:06.312297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a339e867-7420-4242-8792-440ba3c9b4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:06.366644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339e867-7420-4242-8792-440ba3c9b4c3 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:06.370801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949148a-80e1-426c-a858-5d335bb3b01a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:06.371488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949148a-80e1-426c-a858-5d335bb3b01a service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.371773 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949148a-80e1-426c-a858-5d335bb3b01a service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.372055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949148a-80e1-426c-a858-5d335bb3b01a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.381229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949148a-80e1-426c-a858-5d335bb3b01a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:06.382661 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949148a-80e1-426c-a858-5d335bb3b01a service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:06.392067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1332/2674] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:06 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:06.405918 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22220b-afd9-4c3a-8405-d18ef45cd508 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:06.465570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22220b-afd9-4c3a-8405-d18ef45cd508 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:06.470186 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:06.471073 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.471361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.471666 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] PATH_INFO: `/v3/users/315dd15b36be46a5b78dac30071b1f5e` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.472868 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=315dd15b36be46a5b78dac30071b1f5e)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:06.474794 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:06.521874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315dd15b36be46a5b78dac30071b1f5e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:06.529274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315dd15b36be46a5b78dac30071b1f5e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:06.529992 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315dd15b36be46a5b78dac30071b1f5e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:06.530639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315dd15b36be46a5b78dac30071b1f5e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:06.542725 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315dd15b36be46a5b78dac30071b1f5e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:06.558402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1343/2675] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:06 2022] DELETE /identity/v3/users/315dd15b36be46a5b78dac30071b1f5e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:06.564370 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18101a-bf27-4744-9f10-f9272a91fcec None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.564598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18101a-bf27-4744-9f10-f9272a91fcec None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.564838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18101a-bf27-4744-9f10-f9272a91fcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.586625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2e18101a-bf27-4744-9f10-f9272a91fcec None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:06.587994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2e18101a-bf27-4744-9f10-f9272a91fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:06.615215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:06.616673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:06.651290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1333/2676] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:06.660011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18101a-bf27-4744-9f10-f9272a91fcec None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:06.661394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2e18101a-bf27-4744-9f10-f9272a91fcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:06.680553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ec031-beab-4143-8f9a-0280c2500e1a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:06.684448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2722d82-461c-4cc5-b6fa-36b54fc2b896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:06.685107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2722d82-461c-4cc5-b6fa-36b54fc2b896 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.685393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2722d82-461c-4cc5-b6fa-36b54fc2b896 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.685703 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2722d82-461c-4cc5-b6fa-36b54fc2b896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.687630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d2722d82-461c-4cc5-b6fa-36b54fc2b896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:06.699685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2722d82-461c-4cc5-b6fa-36b54fc2b896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:06.701064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2722d82-461c-4cc5-b6fa-36b54fc2b896 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:06.710839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1344/2677] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:44:06.718134 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18101a-bf27-4744-9f10-f9272a91fcec None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:06.721824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb019e-fa64-4a24-9421-43f6e5d5def0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:06.722475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb019e-fa64-4a24-9421-43f6e5d5def0 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.722757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb019e-fa64-4a24-9421-43f6e5d5def0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.723052 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb019e-fa64-4a24-9421-43f6e5d5def0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.734680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb019e-fa64-4a24-9421-43f6e5d5def0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:06.736142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb019e-fa64-4a24-9421-43f6e5d5def0 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:06.745783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1334/2678] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:44:06.908596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2722d82-461c-4cc5-b6fa-36b54fc2b896 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:06.910258 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d2722d82-461c-4cc5-b6fa-36b54fc2b896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:06.922782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2722d82-461c-4cc5-b6fa-36b54fc2b896 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:06.927448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:06.928349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:06.928621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:06.928898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] PATH_INFO: `/v3/users/f2fab376044f4d1a9f54f98db3a5d18b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:06.930100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2fab376044f4d1a9f54f98db3a5d18b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:06.932066 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:06.983697 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2fab376044f4d1a9f54f98db3a5d18b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:06.990715 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2fab376044f4d1a9f54f98db3a5d18b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:06.991505 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2fab376044f4d1a9f54f98db3a5d18b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:06.992142 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2fab376044f4d1a9f54f98db3a5d18b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.005379 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2fab376044f4d1a9f54f98db3a5d18b'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.018543 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1345/2679] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:06 2022] DELETE /identity/v3/users/f2fab376044f4d1a9f54f98db3a5d18b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:07.023020 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc4d9-6648-4cec-8af4-c0f9f0066640 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.023358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc4d9-6648-4cec-8af4-c0f9f0066640 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.023626 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc4d9-6648-4cec-8af4-c0f9f0066640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.041178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-8e1fc4d9-6648-4cec-8af4-c0f9f0066640 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:07.042398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8e1fc4d9-6648-4cec-8af4-c0f9f0066640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:07.114899 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1335/2680] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:07.126942 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.128520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:07.192014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4ad36-452e-47a4-a0b3-6f79c116ae4e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.193101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fc4d9-6648-4cec-8af4-c0f9f0066640 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.194819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8e1fc4d9-6648-4cec-8af4-c0f9f0066640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:07.199017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32647fb-ae1a-4183-a7b6-9fa03a9d57b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.203177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32647fb-ae1a-4183-a7b6-9fa03a9d57b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.203915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32647fb-ae1a-4183-a7b6-9fa03a9d57b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.204470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32647fb-ae1a-4183-a7b6-9fa03a9d57b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.209373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fc4d9-6648-4cec-8af4-c0f9f0066640 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.214490 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.215404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.215931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.216159 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] PATH_INFO: `/v3/projects/0e4f476e6ad74c6a8b0b6f2481642b97` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.217950 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4f476e6ad74c6a8b0b6f2481642b97)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.220137 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:07.225677 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32647fb-ae1a-4183-a7b6-9fa03a9d57b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.227243 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32647fb-ae1a-4183-a7b6-9fa03a9d57b1 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:07.237776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1346/2681] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:07.273736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4f476e6ad74c6a8b0b6f2481642b97', 'request_id': 'req-1b4d9190-8af7-40e7-8ab2-88a780b82a99'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.283119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4f476e6ad74c6a8b0b6f2481642b97', 'request_id': 'req-1b4d9190-8af7-40e7-8ab2-88a780b82a99'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.290099 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4f476e6ad74c6a8b0b6f2481642b97', 'request_id': 'req-1b4d9190-8af7-40e7-8ab2-88a780b82a99'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.302856 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] The token cache is being invalidate because project 0e4f476e6ad74c6a8b0b6f2481642b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:07.303199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.304016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1b4d9190-8af7-40e7-8ab2-88a780b82a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.305926 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1336/2682] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:07 2022] DELETE /identity/v3/projects/0e4f476e6ad74c6a8b0b6f2481642b97 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:44:07.312005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea49d-a734-4521-8987-9b7d487956f7 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.312516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea49d-a734-4521-8987-9b7d487956f7 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.312702 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea49d-a734-4521-8987-9b7d487956f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.331479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-04fea49d-a734-4521-8987-9b7d487956f7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:07.332788 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-04fea49d-a734-4521-8987-9b7d487956f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:07.406013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1347/2683] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:44:07.414854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5eabce-2845-4c93-be41-c12dc09f6b11 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.415205 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5eabce-2845-4c93-be41-c12dc09f6b11 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.415500 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5eabce-2845-4c93-be41-c12dc09f6b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.433791 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-fc5eabce-2845-4c93-be41-c12dc09f6b11 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:07.435114 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-fc5eabce-2845-4c93-be41-c12dc09f6b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:07.444439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1337/2684] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:07.448451 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fea49d-a734-4521-8987-9b7d487956f7 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.458786 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fea49d-a734-4521-8987-9b7d487956f7 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.463687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653e3b9-4372-40a8-b41a-53b59eefdff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.464460 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653e3b9-4372-40a8-b41a-53b59eefdff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.464867 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653e3b9-4372-40a8-b41a-53b59eefdff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.465140 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653e3b9-4372-40a8-b41a-53b59eefdff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.465870 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653e3b9-4372-40a8-b41a-53b59eefdff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:44:07.466230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653e3b9-4372-40a8-b41a-53b59eefdff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.467862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653e3b9-4372-40a8-b41a-53b59eefdff8 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:07.483948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1348/2685] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:44:07.485180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5eabce-2845-4c93-be41-c12dc09f6b11 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.494779 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5eabce-2845-4c93-be41-c12dc09f6b11 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.500052 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb3f91-5ecd-4aa3-9380-b9adddea9a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.500830 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3f91-5ecd-4aa3-9380-b9adddea9a97 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.501121 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3f91-5ecd-4aa3-9380-b9adddea9a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.501401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb3f91-5ecd-4aa3-9380-b9adddea9a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.502097 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb3f91-5ecd-4aa3-9380-b9adddea9a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.504755 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb3f91-5ecd-4aa3-9380-b9adddea9a97 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:07.534045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1338/2686] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:44:07 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:07.535233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653e3b9-4372-40a8-b41a-53b59eefdff8 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.545359 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653e3b9-4372-40a8-b41a-53b59eefdff8 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.601173 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd856f32-b8eb-44ce-8aeb-bdde7cc12514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.601862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd856f32-b8eb-44ce-8aeb-bdde7cc12514 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.602263 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd856f32-b8eb-44ce-8aeb-bdde7cc12514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.602549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd856f32-b8eb-44ce-8aeb-bdde7cc12514 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.603338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd856f32-b8eb-44ce-8aeb-bdde7cc12514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.605750 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd856f32-b8eb-44ce-8aeb-bdde7cc12514 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:07.626795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1349/2687] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:44:07 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:07.631050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb3f91-5ecd-4aa3-9380-b9adddea9a97 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.642290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb3f91-5ecd-4aa3-9380-b9adddea9a97 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.646971 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c663cfd-26cc-4e92-a7b4-28e6a0285582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.647663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c663cfd-26cc-4e92-a7b4-28e6a0285582 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.648001 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c663cfd-26cc-4e92-a7b4-28e6a0285582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.648261 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c663cfd-26cc-4e92-a7b4-28e6a0285582 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.648985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c663cfd-26cc-4e92-a7b4-28e6a0285582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.650629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c663cfd-26cc-4e92-a7b4-28e6a0285582 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:07.661984 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1339/2688] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:44:07.665796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd856f32-b8eb-44ce-8aeb-bdde7cc12514 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.669622 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c663cfd-26cc-4e92-a7b4-28e6a0285582 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.672467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8c663cfd-26cc-4e92-a7b4-28e6a0285582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:07.678118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd856f32-b8eb-44ce-8aeb-bdde7cc12514 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.682950 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac73c0-bdf7-49bd-aef2-83d333d266b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.683967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac73c0-bdf7-49bd-aef2-83d333d266b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.684243 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac73c0-bdf7-49bd-aef2-83d333d266b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.684513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac73c0-bdf7-49bd-aef2-83d333d266b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.685246 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac73c0-bdf7-49bd-aef2-83d333d266b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.687470 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac73c0-bdf7-49bd-aef2-83d333d266b7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:07.690371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c663cfd-26cc-4e92-a7b4-28e6a0285582 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.698294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.699290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.699644 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.699997 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] PATH_INFO: `/v3/projects/61eb72af1a674170bd750135233854c5` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.701365 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] RBAC: Authorizing `identity:delete_project(project_id=61eb72af1a674170bd750135233854c5)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.704016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:07.708219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1350/2689] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:44:07.712554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac73c0-bdf7-49bd-aef2-83d333d266b7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.723809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac73c0-bdf7-49bd-aef2-83d333d266b7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.732123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba8a39-bb6a-4450-8d1f-d9987029443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.733486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8a39-bb6a-4450-8d1f-d9987029443a admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.733486 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8a39-bb6a-4450-8d1f-d9987029443a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.733818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba8a39-bb6a-4450-8d1f-d9987029443a admin admin] PATH_INFO: `/v3/projects/0fb305bc6180479781041bea1418b7f9/users/1faea15ec15e433e87717e3ae8bbd3f2/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.750617 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba8a39-bb6a-4450-8d1f-d9987029443a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb305bc6180479781041bea1418b7f9, user_id=1faea15ec15e433e87717e3ae8bbd3f2, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.753387 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba8a39-bb6a-4450-8d1f-d9987029443a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:07.762938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61eb72af1a674170bd750135233854c5', 'request_id': 'req-d18ea18a-9e37-418b-9e10-b5383159acac'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.770076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61eb72af1a674170bd750135233854c5', 'request_id': 'req-d18ea18a-9e37-418b-9e10-b5383159acac'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.773639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1351/2690] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:44:07 2022] PUT /identity/v3/projects/0fb305bc6180479781041bea1418b7f9/users/1faea15ec15e433e87717e3ae8bbd3f2/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:44:07.777549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61eb72af1a674170bd750135233854c5', 'request_id': 'req-d18ea18a-9e37-418b-9e10-b5383159acac'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.783924 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7419254-2141-4232-bab9-eb1b90b168ce None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.784217 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7419254-2141-4232-bab9-eb1b90b168ce None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.784490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7419254-2141-4232-bab9-eb1b90b168ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.791186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] The token cache is being invalidate because project 61eb72af1a674170bd750135233854c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:07.791592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.792330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:07.794197 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1340/2691] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:07 2022] DELETE /identity/v3/projects/61eb72af1a674170bd750135233854c5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:44:07.798457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.799929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:07.812498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f7419254-2141-4232-bab9-eb1b90b168ce None None] MFA Rules not processed for user `1faea15ec15e433e87717e3ae8bbd3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:07.814000 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f7419254-2141-4232-bab9-eb1b90b168ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:07.868534 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ea18a-9e37-418b-9e10-b5383159acac admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.891009 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1352/2692] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:44:07.903705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7419254-2141-4232-bab9-eb1b90b168ce None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:07.906362 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f7419254-2141-4232-bab9-eb1b90b168ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:07.948009 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.949032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.949421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.949794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] PATH_INFO: `/v3/users/ca38700af7254edbb078538547e7366e` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.951517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca38700af7254edbb078538547e7366e)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.953870 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:07.974695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7419254-2141-4232-bab9-eb1b90b168ce None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:07.979274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ad6b1-8fb3-4cd5-806b-c8d6c218e387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:07.980223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad6b1-8fb3-4cd5-806b-c8d6c218e387 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:07.980658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad6b1-8fb3-4cd5-806b-c8d6c218e387 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:07.981109 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ad6b1-8fb3-4cd5-806b-c8d6c218e387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:07.993235 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ad6b1-8fb3-4cd5-806b-c8d6c218e387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:07.995297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ad6b1-8fb3-4cd5-806b-c8d6c218e387 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:08.006921 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1353/2693] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:44:08.020373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca38700af7254edbb078538547e7366e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.021064 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca38700af7254edbb078538547e7366e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.028931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca38700af7254edbb078538547e7366e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.030559 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca38700af7254edbb078538547e7366e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.038820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ad6b1-8fb3-4cd5-806b-c8d6c218e387 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:08.040441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-496ad6b1-8fb3-4cd5-806b-c8d6c218e387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:08.051229 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-1ed6addc-61a6-4d0a-ae82-28f719296cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca38700af7254edbb078538547e7366e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.060199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ad6b1-8fb3-4cd5-806b-c8d6c218e387 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:08.070072 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:08.071340 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:08.072287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:08.072789 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] PATH_INFO: `/v3/users/1faea15ec15e433e87717e3ae8bbd3f2` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:08.074268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1faea15ec15e433e87717e3ae8bbd3f2)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:08.077105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:08.079115 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1341/2694] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:07 2022] DELETE /identity/v3/users/ca38700af7254edbb078538547e7366e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:44:08.148221 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1faea15ec15e433e87717e3ae8bbd3f2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.157120 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1faea15ec15e433e87717e3ae8bbd3f2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.158014 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1faea15ec15e433e87717e3ae8bbd3f2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.158827 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1faea15ec15e433e87717e3ae8bbd3f2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.173949 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1faea15ec15e433e87717e3ae8bbd3f2'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.193647 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1354/2695] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:08 2022] DELETE /identity/v3/users/1faea15ec15e433e87717e3ae8bbd3f2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:44:08.195519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf2e62-bcb8-4736-bc96-0bdc401cc61a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:08.196003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf2e62-bcb8-4736-bc96-0bdc401cc61a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:08.196122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf2e62-bcb8-4736-bc96-0bdc401cc61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:08.218573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-10cf2e62-bcb8-4736-bc96-0bdc401cc61a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:08.220823 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-10cf2e62-bcb8-4736-bc96-0bdc401cc61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:08.314130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1342/2696] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:44:08.437321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:08.438814 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:08.500233 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a5b2a-cf29-49cc-a76b-8951edcd57dd admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:08.504240 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305960bd-f4e7-4f7a-9cf2-f8c481171402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:08.504927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305960bd-f4e7-4f7a-9cf2-f8c481171402 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:08.505209 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305960bd-f4e7-4f7a-9cf2-f8c481171402 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:08.505483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305960bd-f4e7-4f7a-9cf2-f8c481171402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:08.516397 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305960bd-f4e7-4f7a-9cf2-f8c481171402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:08.518205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305960bd-f4e7-4f7a-9cf2-f8c481171402 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:08.530520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1355/2697] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:08.604672 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf2e62-bcb8-4736-bc96-0bdc401cc61a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:08.606142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-10cf2e62-bcb8-4736-bc96-0bdc401cc61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:08.633323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf2e62-bcb8-4736-bc96-0bdc401cc61a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:08.639738 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:08.640873 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:08.641230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:08.641516 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] PATH_INFO: `/v3/projects/a2b0a0e0b6ce4de2863452f00ffbee3a` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:08.642828 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b0a0e0b6ce4de2863452f00ffbee3a)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:08.644800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:08.692765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b0a0e0b6ce4de2863452f00ffbee3a', 'request_id': 'req-2037d647-5660-4ae6-bf29-9535fdccf906'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.703340 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b0a0e0b6ce4de2863452f00ffbee3a', 'request_id': 'req-2037d647-5660-4ae6-bf29-9535fdccf906'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.708956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b0a0e0b6ce4de2863452f00ffbee3a', 'request_id': 'req-2037d647-5660-4ae6-bf29-9535fdccf906'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.723173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] The token cache is being invalidate because project a2b0a0e0b6ce4de2863452f00ffbee3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:08.723462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.724100 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-2037d647-5660-4ae6-bf29-9535fdccf906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:08.725653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1343/2698] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:08 2022] DELETE /identity/v3/projects/a2b0a0e0b6ce4de2863452f00ffbee3a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:08.730772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4f316-af21-4733-93be-29ca397488cd None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:08.731082 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4f316-af21-4733-93be-29ca397488cd None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:08.731416 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4f316-af21-4733-93be-29ca397488cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:08.750923 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-43c4f316-af21-4733-93be-29ca397488cd None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:08.752106 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-43c4f316-af21-4733-93be-29ca397488cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:08.846005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1356/2699] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:44:08.854953 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974e55-1cbd-4211-9dee-457528570ba8 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:08.855410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974e55-1cbd-4211-9dee-457528570ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:08.855796 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0974e55-1cbd-4211-9dee-457528570ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:08.877395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-f0974e55-1cbd-4211-9dee-457528570ba8 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:08.878619 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f0974e55-1cbd-4211-9dee-457528570ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:08.888866 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1344/2700] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:08.894088 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4f316-af21-4733-93be-29ca397488cd None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:08.904355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4f316-af21-4733-93be-29ca397488cd None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:08.909972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878a4e4-2118-41d4-b0c7-52f1b31714c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:08.910757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878a4e4-2118-41d4-b0c7-52f1b31714c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:08.911143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878a4e4-2118-41d4-b0c7-52f1b31714c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:08.911485 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878a4e4-2118-41d4-b0c7-52f1b31714c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:08.912427 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878a4e4-2118-41d4-b0c7-52f1b31714c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:44:08.912809 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878a4e4-2118-41d4-b0c7-52f1b31714c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:08.914671 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878a4e4-2118-41d4-b0c7-52f1b31714c1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:08.927273 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1357/2701] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:44:08.931616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0974e55-1cbd-4211-9dee-457528570ba8 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:08.941480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0974e55-1cbd-4211-9dee-457528570ba8 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:08.948022 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cfb9d-cbef-4abb-8941-64deef7a9f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:08.948704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cfb9d-cbef-4abb-8941-64deef7a9f16 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:08.948988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cfb9d-cbef-4abb-8941-64deef7a9f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:08.949268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cfb9d-cbef-4abb-8941-64deef7a9f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:08.949981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cfb9d-cbef-4abb-8941-64deef7a9f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:08.952514 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cfb9d-cbef-4abb-8941-64deef7a9f16 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:08.991975 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1345/2702] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:44:08 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:08.996583 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878a4e4-2118-41d4-b0c7-52f1b31714c1 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.009095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878a4e4-2118-41d4-b0c7-52f1b31714c1 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.018016 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cfb9d-cbef-4abb-8941-64deef7a9f16 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.020928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-6f7cfb9d-cbef-4abb-8941-64deef7a9f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:09.092401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058e595-4705-41c3-b2d4-742a4fb90173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.093234 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e595-4705-41c3-b2d4-742a4fb90173 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.093479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e595-4705-41c3-b2d4-742a4fb90173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.093758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058e595-4705-41c3-b2d4-742a4fb90173 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.094906 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058e595-4705-41c3-b2d4-742a4fb90173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.096696 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058e595-4705-41c3-b2d4-742a4fb90173 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.125356 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cfb9d-cbef-4abb-8941-64deef7a9f16 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.126015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1358/2703] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:44:08 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:09.127114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058e595-4705-41c3-b2d4-742a4fb90173 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.127595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.128767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.128767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.128992 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] PATH_INFO: `/v3/projects/0fb305bc6180479781041bea1418b7f9` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.130736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb305bc6180479781041bea1418b7f9)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.132802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.142993 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058e595-4705-41c3-b2d4-742a4fb90173 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.148418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c69c2-895b-48e4-85e1-1f463a044eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.149365 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c69c2-895b-48e4-85e1-1f463a044eae admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.149964 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c69c2-895b-48e4-85e1-1f463a044eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.150395 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c69c2-895b-48e4-85e1-1f463a044eae admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.151315 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c69c2-895b-48e4-85e1-1f463a044eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.153177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c69c2-895b-48e4-85e1-1f463a044eae admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.168352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1359/2704] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:44:09.169453 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c69c2-895b-48e4-85e1-1f463a044eae admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.181797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c69c2-895b-48e4-85e1-1f463a044eae admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.191149 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb305bc6180479781041bea1418b7f9', 'request_id': 'req-77f76186-9c8a-4df5-82e0-6c587e28dc0e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:09.197995 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb305bc6180479781041bea1418b7f9', 'request_id': 'req-77f76186-9c8a-4df5-82e0-6c587e28dc0e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:09.204694 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb305bc6180479781041bea1418b7f9', 'request_id': 'req-77f76186-9c8a-4df5-82e0-6c587e28dc0e'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:09.222727 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] The token cache is being invalidate because project 0fb305bc6180479781041bea1418b7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:09.223059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:09.223725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-77f76186-9c8a-4df5-82e0-6c587e28dc0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:09.225736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1346/2705] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:09 2022] DELETE /identity/v3/projects/0fb305bc6180479781041bea1418b7f9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:09.231208 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88404-da5e-416b-91a8-cd03ec1685f4 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.231750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88404-da5e-416b-91a8-cd03ec1685f4 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.232132 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88404-da5e-416b-91a8-cd03ec1685f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.246274 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca5184-217b-4ce3-b152-805fd1d8bc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.247213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5184-217b-4ce3-b152-805fd1d8bc48 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.247503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5184-217b-4ce3-b152-805fd1d8bc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.247785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca5184-217b-4ce3-b152-805fd1d8bc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.249056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca5184-217b-4ce3-b152-805fd1d8bc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.250802 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca5184-217b-4ce3-b152-805fd1d8bc48 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.254469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-38e88404-da5e-416b-91a8-cd03ec1685f4 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:09.255866 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-38e88404-da5e-416b-91a8-cd03ec1685f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:09.264078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1360/2706] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:44:09.268724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca5184-217b-4ce3-b152-805fd1d8bc48 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.273711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1347/2707] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:09.275004 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d5ca5184-217b-4ce3-b152-805fd1d8bc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:09.275916 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a74e-6617-445d-a54c-58383ea05b8a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.276278 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a74e-6617-445d-a54c-58383ea05b8a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.276656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4a74e-6617-445d-a54c-58383ea05b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.297477 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-68d4a74e-6617-445d-a54c-58383ea05b8a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:09.299146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-68d4a74e-6617-445d-a54c-58383ea05b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:09.311802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1348/2708] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:09.312865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a74e-6617-445d-a54c-58383ea05b8a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.323569 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4a74e-6617-445d-a54c-58383ea05b8a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.329028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4582a7f-c854-4792-ad06-a03a3b600e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.329845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4582a7f-c854-4792-ad06-a03a3b600e11 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.330216 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca5184-217b-4ce3-b152-805fd1d8bc48 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.330358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4582a7f-c854-4792-ad06-a03a3b600e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.330678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4582a7f-c854-4792-ad06-a03a3b600e11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.331849 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4582a7f-c854-4792-ad06-a03a3b600e11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:44:09.332258 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4582a7f-c854-4792-ad06-a03a3b600e11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.334420 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4582a7f-c854-4792-ad06-a03a3b600e11 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.342372 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8332dda-f7b0-4796-ade1-1ea9bc98ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.343299 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332dda-f7b0-4796-ade1-1ea9bc98ae7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.343581 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332dda-f7b0-4796-ade1-1ea9bc98ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.343858 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8332dda-f7b0-4796-ade1-1ea9bc98ae7a admin admin] PATH_INFO: `/v3/projects/286066955b6a410e93a9cc5506bbc35d/users/80cc82e46a2c4b1cb4aa5cf5c3dcdf79/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.352783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1349/2709] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:44:09.353827 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4582a7f-c854-4792-ad06-a03a3b600e11 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.366510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4582a7f-c854-4792-ad06-a03a3b600e11 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.371151 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8332dda-f7b0-4796-ade1-1ea9bc98ae7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=286066955b6a410e93a9cc5506bbc35d, user_id=80cc82e46a2c4b1cb4aa5cf5c3dcdf79, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.374059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a669e-2b00-4d00-ae53-484d2dda19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.374235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a669e-2b00-4d00-ae53-484d2dda19b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.374489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8332dda-f7b0-4796-ade1-1ea9bc98ae7a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.374705 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a669e-2b00-4d00-ae53-484d2dda19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.375391 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a669e-2b00-4d00-ae53-484d2dda19b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.376193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a669e-2b00-4d00-ae53-484d2dda19b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.378232 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a669e-2b00-4d00-ae53-484d2dda19b8 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.404706 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1361/2710] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:44:09 2022] PUT /identity/v3/projects/286066955b6a410e93a9cc5506bbc35d/users/80cc82e46a2c4b1cb4aa5cf5c3dcdf79/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:09.415528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5cfca-8a6e-4ae3-9fed-4e3265f0e6d4 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.415896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5cfca-8a6e-4ae3-9fed-4e3265f0e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.416251 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5cfca-8a6e-4ae3-9fed-4e3265f0e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.419704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1350/2711] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:44:09 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:09.423960 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a669e-2b00-4d00-ae53-484d2dda19b8 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.452528 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-9ae5cfca-8a6e-4ae3-9fed-4e3265f0e6d4 None None] MFA Rules not processed for user `80cc82e46a2c4b1cb4aa5cf5c3dcdf79`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:09.454422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9ae5cfca-8a6e-4ae3-9fed-4e3265f0e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:09.522044 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a669e-2b00-4d00-ae53-484d2dda19b8 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.528520 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3e92-ad92-4e93-958f-4ca1d8ae3340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.529387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3e92-ad92-4e93-958f-4ca1d8ae3340 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.529814 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3e92-ad92-4e93-958f-4ca1d8ae3340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.530193 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d3e92-ad92-4e93-958f-4ca1d8ae3340 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.531008 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d3e92-ad92-4e93-958f-4ca1d8ae3340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.533109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d3e92-ad92-4e93-958f-4ca1d8ae3340 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.553044 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1362/2712] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:09.565380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1351/2713] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:44:09 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:09.566291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5cfca-8a6e-4ae3-9fed-4e3265f0e6d4 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.568431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-9ae5cfca-8a6e-4ae3-9fed-4e3265f0e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:09.569533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3e92-ad92-4e93-958f-4ca1d8ae3340 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.580165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d3e92-ad92-4e93-958f-4ca1d8ae3340 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.586541 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a023f-c36b-4c0f-a4f1-eade0d4ca270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.587392 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a023f-c36b-4c0f-a4f1-eade0d4ca270 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.587667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a023f-c36b-4c0f-a4f1-eade0d4ca270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.587943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a023f-c36b-4c0f-a4f1-eade0d4ca270 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.588673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a023f-c36b-4c0f-a4f1-eade0d4ca270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.590276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335a023f-c36b-4c0f-a4f1-eade0d4ca270 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.603411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1352/2714] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:44:09.605291 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a023f-c36b-4c0f-a4f1-eade0d4ca270 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.617445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a023f-c36b-4c0f-a4f1-eade0d4ca270 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.622526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471859d6-23ec-4606-89b6-d24f576463c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.623426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471859d6-23ec-4606-89b6-d24f576463c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.624202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471859d6-23ec-4606-89b6-d24f576463c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.624483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471859d6-23ec-4606-89b6-d24f576463c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.625218 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471859d6-23ec-4606-89b6-d24f576463c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.626824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471859d6-23ec-4606-89b6-d24f576463c6 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.637369 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5cfca-8a6e-4ae3-9fed-4e3265f0e6d4 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.639063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1353/2715] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:44:09.642791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4676bc8d-24d9-455d-98c6-1b5996cdd75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.643299 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471859d6-23ec-4606-89b6-d24f576463c6 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.643998 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676bc8d-24d9-455d-98c6-1b5996cdd75d service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.644547 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676bc8d-24d9-455d-98c6-1b5996cdd75d service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.644995 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676bc8d-24d9-455d-98c6-1b5996cdd75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.653380 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471859d6-23ec-4606-89b6-d24f576463c6 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.655925 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676bc8d-24d9-455d-98c6-1b5996cdd75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.657430 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4676bc8d-24d9-455d-98c6-1b5996cdd75d service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.659195 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd8ec-07fa-4de5-9944-7ee56b4822d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.660078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd8ec-07fa-4de5-9944-7ee56b4822d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.660358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd8ec-07fa-4de5-9944-7ee56b4822d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.660687 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bfd8ec-07fa-4de5-9944-7ee56b4822d5 admin admin] PATH_INFO: `/v3/projects/49b99f5817284a9db56b6b97a0820781/users/89a38007b4044f0ebc2dc8335fcbe941/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.667630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1363/2716] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 12 14:44:09.676818 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfd8ec-07fa-4de5-9944-7ee56b4822d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b99f5817284a9db56b6b97a0820781, user_id=89a38007b4044f0ebc2dc8335fcbe941, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.679832 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bfd8ec-07fa-4de5-9944-7ee56b4822d5 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.696912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1354/2717] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:44:09 2022] PUT /identity/v3/projects/49b99f5817284a9db56b6b97a0820781/users/89a38007b4044f0ebc2dc8335fcbe941/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:44:09.707863 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca474-e90b-402b-8465-4834c51541b6 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.708155 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca474-e90b-402b-8465-4834c51541b6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.708434 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca474-e90b-402b-8465-4834c51541b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.747069 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-922ca474-e90b-402b-8465-4834c51541b6 None None] MFA Rules not processed for user `89a38007b4044f0ebc2dc8335fcbe941`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:09.748399 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-922ca474-e90b-402b-8465-4834c51541b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:09.819061 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1364/2718] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:44:09.831349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd8ec-07fa-4de5-9944-7ee56b4822d5 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:09.833533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b0bfd8ec-07fa-4de5-9944-7ee56b4822d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:09.913666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bfd8ec-07fa-4de5-9944-7ee56b4822d5 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:09.918049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bdc29-a6d0-4f34-b237-7ecebc04a40f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:09.918778 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bdc29-a6d0-4f34-b237-7ecebc04a40f service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:09.919321 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bdc29-a6d0-4f34-b237-7ecebc04a40f service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:09.919475 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bdc29-a6d0-4f34-b237-7ecebc04a40f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:09.930751 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bdc29-a6d0-4f34-b237-7ecebc04a40f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:09.932296 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bdc29-a6d0-4f34-b237-7ecebc04a40f service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:09.947564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1355/2719] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:12.837053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca474-e90b-402b-8465-4834c51541b6 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:12.910446 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca474-e90b-402b-8465-4834c51541b6 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:12.915312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:12.916257 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:12.916645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:12.916991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] PATH_INFO: `/v3/users/80cc82e46a2c4b1cb4aa5cf5c3dcdf79` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:12.919064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80cc82e46a2c4b1cb4aa5cf5c3dcdf79)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:12.920888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:12.979656 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80cc82e46a2c4b1cb4aa5cf5c3dcdf79'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:12.988175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80cc82e46a2c4b1cb4aa5cf5c3dcdf79'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:12.988962 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80cc82e46a2c4b1cb4aa5cf5c3dcdf79'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:12.989630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80cc82e46a2c4b1cb4aa5cf5c3dcdf79'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:13.009445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80cc82e46a2c4b1cb4aa5cf5c3dcdf79'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:13.032183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1365/2720] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:12 2022] DELETE /identity/v3/users/80cc82e46a2c4b1cb4aa5cf5c3dcdf79 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:13.036183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4e50-15f3-48c8-8bb3-b56c51a39ae8 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:13.036672 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4e50-15f3-48c8-8bb3-b56c51a39ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:13.036940 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4e50-15f3-48c8-8bb3-b56c51a39ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:13.055188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-cb9b4e50-15f3-48c8-8bb3-b56c51a39ae8 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:13.056539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cb9b4e50-15f3-48c8-8bb3-b56c51a39ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:13.119300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1356/2721] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:13.129118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:13.130537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:13.209668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c7c61-edb3-4ec4-a3f7-19c2783672a5 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:13.214405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18f59d-59b3-406a-80c9-d9b525380422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:13.215615 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f59d-59b3-406a-80c9-d9b525380422 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:13.216115 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f59d-59b3-406a-80c9-d9b525380422 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:13.216507 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f59d-59b3-406a-80c9-d9b525380422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:13.233554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18f59d-59b3-406a-80c9-d9b525380422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:13.236502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18f59d-59b3-406a-80c9-d9b525380422 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:13.283753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1366/2722] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:13.755800 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4e50-15f3-48c8-8bb3-b56c51a39ae8 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:13.757599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cb9b4e50-15f3-48c8-8bb3-b56c51a39ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:13.788084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4e50-15f3-48c8-8bb3-b56c51a39ae8 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:13.800652 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:13.801536 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:13.801812 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:13.802083 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] PATH_INFO: `/v3/projects/286066955b6a410e93a9cc5506bbc35d` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:13.803350 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286066955b6a410e93a9cc5506bbc35d)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:13.805235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:13.856514 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286066955b6a410e93a9cc5506bbc35d', 'request_id': 'req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:13.863442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286066955b6a410e93a9cc5506bbc35d', 'request_id': 'req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:13.870896 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286066955b6a410e93a9cc5506bbc35d', 'request_id': 'req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:13.886290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] The token cache is being invalidate because project 286066955b6a410e93a9cc5506bbc35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:13.886588 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:13.888246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-fca4abad-bc88-4a72-8e5f-f964b1ae9b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:13.890647 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1357/2723] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:13 2022] DELETE /identity/v3/projects/286066955b6a410e93a9cc5506bbc35d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:13.895352 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164192d4-3073-404f-b0c2-b7241fd579c9 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:13.895928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164192d4-3073-404f-b0c2-b7241fd579c9 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:13.896084 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164192d4-3073-404f-b0c2-b7241fd579c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:13.914123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-164192d4-3073-404f-b0c2-b7241fd579c9 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:13.915390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-164192d4-3073-404f-b0c2-b7241fd579c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:13.991062 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1367/2724] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:13.999855 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5669302-8269-4ec5-a350-eaef730c851a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.000144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5669302-8269-4ec5-a350-eaef730c851a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.000424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5669302-8269-4ec5-a350-eaef730c851a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.022201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-b5669302-8269-4ec5-a350-eaef730c851a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:14.023480 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-b5669302-8269-4ec5-a350-eaef730c851a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:14.033041 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1358/2725] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:14.038213 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164192d4-3073-404f-b0c2-b7241fd579c9 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:14.048476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164192d4-3073-404f-b0c2-b7241fd579c9 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:14.053214 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c66ae-f1d1-411f-ad42-678468c07642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:14.053880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c66ae-f1d1-411f-ad42-678468c07642 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.054167 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c66ae-f1d1-411f-ad42-678468c07642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.054448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c66ae-f1d1-411f-ad42-678468c07642 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.055226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c66ae-f1d1-411f-ad42-678468c07642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:44:14.055538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c66ae-f1d1-411f-ad42-678468c07642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:14.057162 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c66ae-f1d1-411f-ad42-678468c07642 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:14.070448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1368/2726] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:44:14.075162 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5669302-8269-4ec5-a350-eaef730c851a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:14.085155 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5669302-8269-4ec5-a350-eaef730c851a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:14.090076 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b4de9-ff99-4e85-af07-7631789d5bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:14.091078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b4de9-ff99-4e85-af07-7631789d5bbc admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.091078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b4de9-ff99-4e85-af07-7631789d5bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.091374 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b4de9-ff99-4e85-af07-7631789d5bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.092166 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b4de9-ff99-4e85-af07-7631789d5bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:14.094048 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b4de9-ff99-4e85-af07-7631789d5bbc admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:14.125797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1359/2727] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:44:14 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:14.129877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c66ae-f1d1-411f-ad42-678468c07642 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:14.140568 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c66ae-f1d1-411f-ad42-678468c07642 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:14.197436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b43948-9d66-4aa9-8a01-76023ceb12ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:14.198116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b43948-9d66-4aa9-8a01-76023ceb12ab admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.198402 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b43948-9d66-4aa9-8a01-76023ceb12ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.198681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b43948-9d66-4aa9-8a01-76023ceb12ab admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.199442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b43948-9d66-4aa9-8a01-76023ceb12ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:14.201393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b43948-9d66-4aa9-8a01-76023ceb12ab admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:14.224462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1369/2728] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:44:14 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:44:14.225636 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b43948-9d66-4aa9-8a01-76023ceb12ab admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:14.226024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b4de9-ff99-4e85-af07-7631789d5bbc admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:14.228104 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-874b4de9-ff99-4e85-af07-7631789d5bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:14.235956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b43948-9d66-4aa9-8a01-76023ceb12ab admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:14.240982 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad59dfb-4b56-4d37-8ed9-675ead182451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:14.241658 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59dfb-4b56-4d37-8ed9-675ead182451 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.241947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59dfb-4b56-4d37-8ed9-675ead182451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.242232 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad59dfb-4b56-4d37-8ed9-675ead182451 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.242965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad59dfb-4b56-4d37-8ed9-675ead182451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:14.244911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad59dfb-4b56-4d37-8ed9-675ead182451 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:14.247893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b4de9-ff99-4e85-af07-7631789d5bbc admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:14.252584 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:14.253546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.253989 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.254333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] PATH_INFO: `/v3/users/a64c3ea69151401897e4203095676543` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.255111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1370/2729] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:44:14.258434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64c3ea69151401897e4203095676543)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:14.258763 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad59dfb-4b56-4d37-8ed9-675ead182451 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:14.260410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:14.268422 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad59dfb-4b56-4d37-8ed9-675ead182451 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:14.272978 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74646f49-6be2-45e7-b179-b5d0c728c179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:14.273621 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74646f49-6be2-45e7-b179-b5d0c728c179 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.273906 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74646f49-6be2-45e7-b179-b5d0c728c179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.274185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74646f49-6be2-45e7-b179-b5d0c728c179 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.275013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74646f49-6be2-45e7-b179-b5d0c728c179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:14.276634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74646f49-6be2-45e7-b179-b5d0c728c179 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:14.291494 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1371/2730] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:44:14.292625 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74646f49-6be2-45e7-b179-b5d0c728c179 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:14.303676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74646f49-6be2-45e7-b179-b5d0c728c179 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:14.308559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347ec56-4260-4c52-898d-706d7ad1a92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:14.309428 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347ec56-4260-4c52-898d-706d7ad1a92c admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.309710 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347ec56-4260-4c52-898d-706d7ad1a92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.310114 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347ec56-4260-4c52-898d-706d7ad1a92c admin admin] PATH_INFO: `/v3/projects/acae066a447040f98bf289109ed61c77/users/426f0c09f59941b195964297fd3dc6b4/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.311575 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64c3ea69151401897e4203095676543'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.312236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64c3ea69151401897e4203095676543'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.319456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64c3ea69151401897e4203095676543'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.320024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64c3ea69151401897e4203095676543'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.325111 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347ec56-4260-4c52-898d-706d7ad1a92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=acae066a447040f98bf289109ed61c77, user_id=426f0c09f59941b195964297fd3dc6b4, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:14.328376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347ec56-4260-4c52-898d-706d7ad1a92c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:14.329496 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64c3ea69151401897e4203095676543'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.342640 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1372/2731] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:44:14 2022] PUT /identity/v3/projects/acae066a447040f98bf289109ed61c77/users/426f0c09f59941b195964297fd3dc6b4/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:14.347645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e31f2c-fc25-404a-914c-d5acd1c140ce None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.348021 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e31f2c-fc25-404a-914c-d5acd1c140ce None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.348376 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e31f2c-fc25-404a-914c-d5acd1c140ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.351288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1360/2732] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:14 2022] DELETE /identity/v3/users/a64c3ea69151401897e4203095676543 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:14.367672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-16e31f2c-fc25-404a-914c-d5acd1c140ce None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:14.369255 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-16e31f2c-fc25-404a-914c-d5acd1c140ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:14.438351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1373/2733] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:44:14.449408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:14.450090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:14.511844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704d5e0-3749-4946-9c5c-117f14101f5a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:14.517685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd704d6-1c7c-4bba-8bdd-73153d31dbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:14.518338 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd704d6-1c7c-4bba-8bdd-73153d31dbea service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.518620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd704d6-1c7c-4bba-8bdd-73153d31dbea service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.518892 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd704d6-1c7c-4bba-8bdd-73153d31dbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.528724 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd704d6-1c7c-4bba-8bdd-73153d31dbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:14.531502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd704d6-1c7c-4bba-8bdd-73153d31dbea service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:14.551956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e31f2c-fc25-404a-914c-d5acd1c140ce None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:14.553380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-16e31f2c-fc25-404a-914c-d5acd1c140ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:14.559239 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1361/2734] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:14.580509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e31f2c-fc25-404a-914c-d5acd1c140ce None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:14.585935 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:14.586887 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.587215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.587567 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] PATH_INFO: `/v3/projects/0ba0ea753bb0496cbf274e802f50dd0e` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.588739 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba0ea753bb0496cbf274e802f50dd0e)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:14.590664 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:14.651001 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba0ea753bb0496cbf274e802f50dd0e', 'request_id': 'req-e5fa9350-8934-48cf-b236-58013f47ca7e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.660758 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba0ea753bb0496cbf274e802f50dd0e', 'request_id': 'req-e5fa9350-8934-48cf-b236-58013f47ca7e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.668241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba0ea753bb0496cbf274e802f50dd0e', 'request_id': 'req-e5fa9350-8934-48cf-b236-58013f47ca7e'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.681654 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] The token cache is being invalidate because project 0ba0ea753bb0496cbf274e802f50dd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:14.681948 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.682614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.685149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1374/2735] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:14 2022] DELETE /identity/v3/projects/0ba0ea753bb0496cbf274e802f50dd0e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:14.688898 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd704d6-1c7c-4bba-8bdd-73153d31dbea service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:14.699624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd704d6-1c7c-4bba-8bdd-73153d31dbea service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:14.774400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:14.775401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:14.775684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:14.775986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] PATH_INFO: `/v3/users/f0b4b4e69c104c00b816b79479a54080` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:14.791394 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b4b4e69c104c00b816b79479a54080)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:14.793632 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:14.845587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b4b4e69c104c00b816b79479a54080'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.847050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b4b4e69c104c00b816b79479a54080'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.855364 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b4b4e69c104c00b816b79479a54080'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.856084 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b4b4e69c104c00b816b79479a54080'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.865401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-c31d754d-0ce2-4a81-969e-8336f8f3e7b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b4b4e69c104c00b816b79479a54080'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:14.892209 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1362/2736] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:14 2022] DELETE /identity/v3/users/f0b4b4e69c104c00b816b79479a54080 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:15.114598 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:15.116198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:15.131261 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa9350-8934-48cf-b236-58013f47ca7e admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:15.211854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:15.213188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:15.213673 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:15.214156 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] PATH_INFO: `/v3/projects/3a4c510b25264c69a2b03086eeb7d37b` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:15.227078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ece2a-4ea1-4231-9e08-ed3ff0dd76f9 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:15.227933 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ece2a-4ea1-4231-9e08-ed3ff0dd76f9 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:15.228216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ece2a-4ea1-4231-9e08-ed3ff0dd76f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:15.237458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a4c510b25264c69a2b03086eeb7d37b)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:15.239633 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:15.259068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-066ece2a-4ea1-4231-9e08-ed3ff0dd76f9 None None] MFA Rules not processed for user `426f0c09f59941b195964297fd3dc6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:15.260297 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-066ece2a-4ea1-4231-9e08-ed3ff0dd76f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:15.302495 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a4c510b25264c69a2b03086eeb7d37b', 'request_id': 'req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:15.313532 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a4c510b25264c69a2b03086eeb7d37b', 'request_id': 'req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:15.321242 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a4c510b25264c69a2b03086eeb7d37b', 'request_id': 'req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:15.348388 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] The token cache is being invalidate because project 3a4c510b25264c69a2b03086eeb7d37b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:15.348790 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:15.349525 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:15.351757 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1375/2737] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:15 2022] DELETE /identity/v3/projects/3a4c510b25264c69a2b03086eeb7d37b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:15.378332 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1363/2738] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:15.389927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:15.391717 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:15.478529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a0457-fb3a-4666-a7f0-4cdb771872b0 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:15.483934 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb116-ca84-4cf8-8982-5fcf7fd261c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:15.485243 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb116-ca84-4cf8-8982-5fcf7fd261c6 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:15.485736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb116-ca84-4cf8-8982-5fcf7fd261c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:15.486824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bb116-ca84-4cf8-8982-5fcf7fd261c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:15.574067 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bb116-ca84-4cf8-8982-5fcf7fd261c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:15.575741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bb116-ca84-4cf8-8982-5fcf7fd261c6 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:15.591766 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1376/2739] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:16.940529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f512d7-2ea9-40a9-9c60-0cd319387cbc None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:16.941013 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f512d7-2ea9-40a9-9c60-0cd319387cbc None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:16.941135 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f512d7-2ea9-40a9-9c60-0cd319387cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:16.962263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-17f512d7-2ea9-40a9-9c60-0cd319387cbc None None] MFA Rules not processed for user `426f0c09f59941b195964297fd3dc6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:16.963593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-17f512d7-2ea9-40a9-9c60-0cd319387cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:16.971311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1364/2740] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:44:17.205332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb116-ca84-4cf8-8982-5fcf7fd261c6 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:17.206849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-157bb116-ca84-4cf8-8982-5fcf7fd261c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:17.261189 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bb116-ca84-4cf8-8982-5fcf7fd261c6 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:17.265388 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696710de-2db3-42f7-a223-1864e10d5532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:17.266021 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696710de-2db3-42f7-a223-1864e10d5532 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:17.266300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696710de-2db3-42f7-a223-1864e10d5532 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:17.266570 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696710de-2db3-42f7-a223-1864e10d5532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:17.268344 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-696710de-2db3-42f7-a223-1864e10d5532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:17.278179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696710de-2db3-42f7-a223-1864e10d5532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:17.279661 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696710de-2db3-42f7-a223-1864e10d5532 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:17.287549 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1377/2741] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:17.595662 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f512d7-2ea9-40a9-9c60-0cd319387cbc None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:17.597140 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-17f512d7-2ea9-40a9-9c60-0cd319387cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:17.668975 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f512d7-2ea9-40a9-9c60-0cd319387cbc None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:17.674468 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d800b6-ff34-4658-b375-8d497a846f9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3004f3e4a9854502be59119e17e04961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:17.675152 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d800b6-ff34-4658-b375-8d497a846f9f service placement] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:17.675437 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d800b6-ff34-4658-b375-8d497a846f9f service placement] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:17.675713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d800b6-ff34-4658-b375-8d497a846f9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:17.677461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-19d800b6-ff34-4658-b375-8d497a846f9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:17.689078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d800b6-ff34-4658-b375-8d497a846f9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:17.690639 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d800b6-ff34-4658-b375-8d497a846f9f service placement] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:17.700507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1365/2742] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:20.236969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696710de-2db3-42f7-a223-1864e10d5532 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:20.238388 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-696710de-2db3-42f7-a223-1864e10d5532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:20.307076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696710de-2db3-42f7-a223-1864e10d5532 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:20.313645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:20.314519 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:20.314799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:20.315098 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] PATH_INFO: `/v3/users/89a38007b4044f0ebc2dc8335fcbe941` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:20.316321 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a38007b4044f0ebc2dc8335fcbe941)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:20.318313 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:20.371223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a38007b4044f0ebc2dc8335fcbe941'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:20.378685 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a38007b4044f0ebc2dc8335fcbe941'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:20.379483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a38007b4044f0ebc2dc8335fcbe941'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:20.380152 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a38007b4044f0ebc2dc8335fcbe941'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:20.393116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a38007b4044f0ebc2dc8335fcbe941'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:20.407752 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1378/2743] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:20 2022] DELETE /identity/v3/users/89a38007b4044f0ebc2dc8335fcbe941 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:20.412308 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1904-48e9-43a7-8f8f-7662edcb8f46 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:20.412794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1904-48e9-43a7-8f8f-7662edcb8f46 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:20.412970 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1904-48e9-43a7-8f8f-7662edcb8f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:20.430342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-59ff1904-48e9-43a7-8f8f-7662edcb8f46 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:20.431659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-59ff1904-48e9-43a7-8f8f-7662edcb8f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:20.491059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1366/2744] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:20.501574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:20.502986 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:20.559170 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0d840-afa8-4e92-9762-626fdb24ca15 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:20.563591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c48a3-f301-40d1-8ccd-56b13781d7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:20.564237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c48a3-f301-40d1-8ccd-56b13781d7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:20.564522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c48a3-f301-40d1-8ccd-56b13781d7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:20.564798 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c48a3-f301-40d1-8ccd-56b13781d7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:20.574018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c48a3-f301-40d1-8ccd-56b13781d7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:20.575495 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c48a3-f301-40d1-8ccd-56b13781d7c9 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:20.585952 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1379/2745] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:20.854129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff1904-48e9-43a7-8f8f-7662edcb8f46 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:20.855656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-59ff1904-48e9-43a7-8f8f-7662edcb8f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:20.868106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff1904-48e9-43a7-8f8f-7662edcb8f46 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:20.872910 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:20.874493 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:20.874770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:20.875059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] PATH_INFO: `/v3/projects/49b99f5817284a9db56b6b97a0820781` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:20.876265 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b99f5817284a9db56b6b97a0820781)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:20.878175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:20.923089 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b99f5817284a9db56b6b97a0820781', 'request_id': 'req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:20.929011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b99f5817284a9db56b6b97a0820781', 'request_id': 'req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:20.934130 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b99f5817284a9db56b6b97a0820781', 'request_id': 'req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:20.947017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] The token cache is being invalidate because project 49b99f5817284a9db56b6b97a0820781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:20.947337 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:20.948027 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-57d6d820-7b6a-4bfb-a8aa-04f2fe0c60e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:20.949659 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1367/2746] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:20 2022] DELETE /identity/v3/projects/49b99f5817284a9db56b6b97a0820781 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:20.954660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e67065-df2c-4f3d-b44b-9875c1a3db26 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:20.954972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e67065-df2c-4f3d-b44b-9875c1a3db26 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:20.955272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e67065-df2c-4f3d-b44b-9875c1a3db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:20.973250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a8e67065-df2c-4f3d-b44b-9875c1a3db26 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:20.974473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a8e67065-df2c-4f3d-b44b-9875c1a3db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:21.039787 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1380/2747] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:21.048771 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7846a6-cac0-4213-b9e2-d6b7d332078f None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:21.049058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7846a6-cac0-4213-b9e2-d6b7d332078f None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:21.049395 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7846a6-cac0-4213-b9e2-d6b7d332078f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:21.072235 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2d7846a6-cac0-4213-b9e2-d6b7d332078f None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:21.073457 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2d7846a6-cac0-4213-b9e2-d6b7d332078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:21.081547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1368/2748] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:21.085511 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e67065-df2c-4f3d-b44b-9875c1a3db26 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:21.095559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e67065-df2c-4f3d-b44b-9875c1a3db26 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:21.100312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71530966-269d-4202-b861-6a6f48589638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:21.100911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71530966-269d-4202-b861-6a6f48589638 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:21.101197 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71530966-269d-4202-b861-6a6f48589638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:21.101476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71530966-269d-4202-b861-6a6f48589638 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:21.102207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71530966-269d-4202-b861-6a6f48589638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:44:21.102515 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71530966-269d-4202-b861-6a6f48589638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:21.104266 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71530966-269d-4202-b861-6a6f48589638 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:21.116337 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1381/2749] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:44:21.120865 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7846a6-cac0-4213-b9e2-d6b7d332078f None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:21.130028 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7846a6-cac0-4213-b9e2-d6b7d332078f None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:21.134944 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe45588-d38d-4309-89b3-6a10421178ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:21.135733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe45588-d38d-4309-89b3-6a10421178ce admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:21.136078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe45588-d38d-4309-89b3-6a10421178ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:21.136442 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe45588-d38d-4309-89b3-6a10421178ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:21.137245 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe45588-d38d-4309-89b3-6a10421178ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:21.139254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe45588-d38d-4309-89b3-6a10421178ce admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:21.168257 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1369/2750] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:44:21 2022] POST /identity/v3/projects => generated 395 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:21.171762 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71530966-269d-4202-b861-6a6f48589638 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:21.182351 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71530966-269d-4202-b861-6a6f48589638 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:21.236273 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd4ffe-3bf1-4c92-a884-767404f69959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:21.236928 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4ffe-3bf1-4c92-a884-767404f69959 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:21.237207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4ffe-3bf1-4c92-a884-767404f69959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:21.237743 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd4ffe-3bf1-4c92-a884-767404f69959 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:21.238139 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd4ffe-3bf1-4c92-a884-767404f69959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:21.240128 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd4ffe-3bf1-4c92-a884-767404f69959 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:21.258779 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1382/2751] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:44:21 2022] POST /identity/v3/users => generated 298 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:44:21.262963 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe45588-d38d-4309-89b3-6a10421178ce admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:21.273402 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe45588-d38d-4309-89b3-6a10421178ce admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:21.278150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def3b70-5728-49fa-a324-efbb63359f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:21.278681 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def3b70-5728-49fa-a324-efbb63359f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:21.278974 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def3b70-5728-49fa-a324-efbb63359f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:21.279270 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def3b70-5728-49fa-a324-efbb63359f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:21.280632 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def3b70-5728-49fa-a324-efbb63359f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:21.282148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def3b70-5728-49fa-a324-efbb63359f2a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:21.292447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1370/2752] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:44:21.296468 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd4ffe-3bf1-4c92-a884-767404f69959 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:21.306232 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd4ffe-3bf1-4c92-a884-767404f69959 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:21.310834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f29a03-f43b-4b5a-b7b7-659e2ee7f3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:21.311520 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f29a03-f43b-4b5a-b7b7-659e2ee7f3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:21.311805 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f29a03-f43b-4b5a-b7b7-659e2ee7f3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:21.312083 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f29a03-f43b-4b5a-b7b7-659e2ee7f3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:21.312811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f29a03-f43b-4b5a-b7b7-659e2ee7f3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:21.314408 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f29a03-f43b-4b5a-b7b7-659e2ee7f3c5 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:21.323909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1383/2753] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:44:21.328591 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def3b70-5728-49fa-a324-efbb63359f2a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:21.343238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def3b70-5728-49fa-a324-efbb63359f2a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:21.349834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fad46-6ff4-40d3-a322-4fe387672eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:21.351365 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fad46-6ff4-40d3-a322-4fe387672eed admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:21.351806 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fad46-6ff4-40d3-a322-4fe387672eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:21.352287 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fad46-6ff4-40d3-a322-4fe387672eed admin admin] PATH_INFO: `/v3/projects/213d50fb344c4e409d5e5c29a693f2ca/users/377b93c25bcf491b8c7823ecdb7b908c/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:21.371617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fad46-6ff4-40d3-a322-4fe387672eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=213d50fb344c4e409d5e5c29a693f2ca, user_id=377b93c25bcf491b8c7823ecdb7b908c, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:21.374368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388fad46-6ff4-40d3-a322-4fe387672eed admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:21.388156 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1371/2754] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:44:21 2022] PUT /identity/v3/projects/213d50fb344c4e409d5e5c29a693f2ca/users/377b93c25bcf491b8c7823ecdb7b908c/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:21.399991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cec2da-00e8-4bac-b68d-1bb5920138f6 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:21.400277 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cec2da-00e8-4bac-b68d-1bb5920138f6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:21.400554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cec2da-00e8-4bac-b68d-1bb5920138f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:21.428039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d1cec2da-00e8-4bac-b68d-1bb5920138f6 None None] MFA Rules not processed for user `377b93c25bcf491b8c7823ecdb7b908c`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:21.429226 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d1cec2da-00e8-4bac-b68d-1bb5920138f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:21.490190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1384/2755] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:21.501751 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fad46-6ff4-40d3-a322-4fe387672eed admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:21.503529 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-388fad46-6ff4-40d3-a322-4fe387672eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:21.557803 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fad46-6ff4-40d3-a322-4fe387672eed admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:21.561750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c283b5f-2bcb-474e-b921-e18af706b0c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:21.562404 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283b5f-2bcb-474e-b921-e18af706b0c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:21.562685 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283b5f-2bcb-474e-b921-e18af706b0c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:21.562986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c283b5f-2bcb-474e-b921-e18af706b0c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:21.572381 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c283b5f-2bcb-474e-b921-e18af706b0c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:21.573807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c283b5f-2bcb-474e-b921-e18af706b0c9 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:21.582915 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1372/2756] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:29.357290 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cec2da-00e8-4bac-b68d-1bb5920138f6 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:29.359150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d1cec2da-00e8-4bac-b68d-1bb5920138f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:29.439947 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cec2da-00e8-4bac-b68d-1bb5920138f6 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:29.445396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf5906-0b9e-4850-bcdb-54e154fbded4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:29.446043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf5906-0b9e-4850-bcdb-54e154fbded4 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:29.446327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf5906-0b9e-4850-bcdb-54e154fbded4 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:29.446601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf5906-0b9e-4850-bcdb-54e154fbded4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:29.448440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-0baf5906-0b9e-4850-bcdb-54e154fbded4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:29.460857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf5906-0b9e-4850-bcdb-54e154fbded4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:29.462439 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf5906-0b9e-4850-bcdb-54e154fbded4 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:29.472716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1385/2757] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:30.622893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c283b5f-2bcb-474e-b921-e18af706b0c9 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:30.682595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c283b5f-2bcb-474e-b921-e18af706b0c9 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:30.687650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:30.688506 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:30.688785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:30.689059 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] PATH_INFO: `/v3/users/377b93c25bcf491b8c7823ecdb7b908c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:30.690230 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=377b93c25bcf491b8c7823ecdb7b908c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:30.692160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:30.735054 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377b93c25bcf491b8c7823ecdb7b908c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:30.735702 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377b93c25bcf491b8c7823ecdb7b908c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:30.742653 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377b93c25bcf491b8c7823ecdb7b908c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:30.743326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377b93c25bcf491b8c7823ecdb7b908c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:30.751286 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377b93c25bcf491b8c7823ecdb7b908c'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:30.768499 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1373/2758] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:44:30 2022] DELETE /identity/v3/users/377b93c25bcf491b8c7823ecdb7b908c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:30.773089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f71e6-459b-4e76-b88f-7ea6decc8372 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:30.773560 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f71e6-459b-4e76-b88f-7ea6decc8372 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:30.773659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f71e6-459b-4e76-b88f-7ea6decc8372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:30.790609 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-910f71e6-459b-4e76-b88f-7ea6decc8372 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:30.791861 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-910f71e6-459b-4e76-b88f-7ea6decc8372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:30.846769 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1386/2759] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:30.856494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:30.857931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:30.914302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c5991-e6b5-4f9b-9ec6-e09620d6f531 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:30.917948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e541b6d-5026-4a65-a342-f533e2de8a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:30.918589 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e541b6d-5026-4a65-a342-f533e2de8a3f service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:30.918875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e541b6d-5026-4a65-a342-f533e2de8a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:30.919185 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e541b6d-5026-4a65-a342-f533e2de8a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:30.929063 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e541b6d-5026-4a65-a342-f533e2de8a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:30.930496 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e541b6d-5026-4a65-a342-f533e2de8a3f service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:30.940461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1374/2760] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:44:31.210080 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f71e6-459b-4e76-b88f-7ea6decc8372 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:31.211537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-910f71e6-459b-4e76-b88f-7ea6decc8372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:31.223514 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f71e6-459b-4e76-b88f-7ea6decc8372 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:31.228414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:31.229279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:31.229630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:31.229842 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] PATH_INFO: `/v3/projects/213d50fb344c4e409d5e5c29a693f2ca` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:31.231540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=213d50fb344c4e409d5e5c29a693f2ca)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:31.233550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:31.285462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213d50fb344c4e409d5e5c29a693f2ca', 'request_id': 'req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:31.292804 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213d50fb344c4e409d5e5c29a693f2ca', 'request_id': 'req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:31.298538 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213d50fb344c4e409d5e5c29a693f2ca', 'request_id': 'req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:31.309441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] The token cache is being invalidate because project 213d50fb344c4e409d5e5c29a693f2ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:44:31.309728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:31.310356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-676d033d-eb68-4a30-a1b3-0c0bf962f7a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:44:31.312531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1387/2761] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:44:31 2022] DELETE /identity/v3/projects/213d50fb344c4e409d5e5c29a693f2ca => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:44:35.840703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917967-3852-487c-beca-06b44b063f3a None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:35.842930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917967-3852-487c-beca-06b44b063f3a None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:35.842930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f917967-3852-487c-beca-06b44b063f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:35.860489 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-7f917967-3852-487c-beca-06b44b063f3a None None] MFA Rules not processed for user `426f0c09f59941b195964297fd3dc6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:35.861951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7f917967-3852-487c-beca-06b44b063f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:35.919019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1375/2762] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:44:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:58.411016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74573b6-9e71-4835-8c5d-bf4bad230ca3 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:58.411550 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74573b6-9e71-4835-8c5d-bf4bad230ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:58.411665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74573b6-9e71-4835-8c5d-bf4bad230ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:58.467751 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e74573b6-9e71-4835-8c5d-bf4bad230ca3 None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:44:58.468981 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e74573b6-9e71-4835-8c5d-bf4bad230ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:58.530963 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1388/2763] 10.222.0.75 () {58 vars in 1009 bytes} [Thu May 12 14:44:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:44:58.576654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f917967-3852-487c-beca-06b44b063f3a None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:44:58.578785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-7f917967-3852-487c-beca-06b44b063f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:44:58.666549 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f917967-3852-487c-beca-06b44b063f3a None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:44:58.671424 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341471c9-741f-44b0-8ace-0959c34c5020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:44:58.672061 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341471c9-741f-44b0-8ace-0959c34c5020 service swift] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:44:58.672339 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341471c9-741f-44b0-8ace-0959c34c5020 service swift] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:44:58.672613 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341471c9-741f-44b0-8ace-0959c34c5020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:44:58.680732 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341471c9-741f-44b0-8ace-0959c34c5020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:44:58.682330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341471c9-741f-44b0-8ace-0959c34c5020 service swift] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:44:58.690620 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1376/2764] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:44:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 14:45:14.572170 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82879ec-4d20-4d13-bc6e-6351351d50b4 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:14.572660 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82879ec-4d20-4d13-bc6e-6351351d50b4 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:14.572768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82879ec-4d20-4d13-bc6e-6351351d50b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:14.589866 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f82879ec-4d20-4d13-bc6e-6351351d50b4 None None] MFA Rules not processed for user `599088a56dbf4c4b9aba49fcbfce8362`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:14.591076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f82879ec-4d20-4d13-bc6e-6351351d50b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:14.598145 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1389/2765] 10.222.0.75 () {58 vars in 967 bytes} [Thu May 12 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:14.610470 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341471c9-741f-44b0-8ace-0959c34c5020 service swift] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:14.620922 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341471c9-741f-44b0-8ace-0959c34c5020 service swift] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:14.626501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86372bc-0e6c-4e2b-996e-19e45a8d3693 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2893125208864a1ab2c32e50d5da3f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:14.627165 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86372bc-0e6c-4e2b-996e-19e45a8d3693 service swift] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:14.627448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86372bc-0e6c-4e2b-996e-19e45a8d3693 service swift] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:14.627721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86372bc-0e6c-4e2b-996e-19e45a8d3693 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:14.635512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86372bc-0e6c-4e2b-996e-19e45a8d3693 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:14.637019 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86372bc-0e6c-4e2b-996e-19e45a8d3693 service swift] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:14.645547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1377/2766] 10.222.0.75 () {60 vars in 1384 bytes} [Thu May 12 14:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 12 14:45:16.501831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82879ec-4d20-4d13-bc6e-6351351d50b4 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:16.503300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f82879ec-4d20-4d13-bc6e-6351351d50b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:16.570373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82879ec-4d20-4d13-bc6e-6351351d50b4 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:16.574761 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:16.575649 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:16.575930 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:16.576201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] PATH_INFO: `/v3/users/426f0c09f59941b195964297fd3dc6b4` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:16.577401 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=426f0c09f59941b195964297fd3dc6b4)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:16.579356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:16.624895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426f0c09f59941b195964297fd3dc6b4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:16.631440 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426f0c09f59941b195964297fd3dc6b4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:16.632103 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426f0c09f59941b195964297fd3dc6b4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:16.632717 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426f0c09f59941b195964297fd3dc6b4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:16.643996 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-304ea9ca-e02f-4ebb-ad5d-d0b743f24531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426f0c09f59941b195964297fd3dc6b4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:16.657199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1390/2767] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:45:16 2022] DELETE /identity/v3/users/426f0c09f59941b195964297fd3dc6b4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:16.825505 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86372bc-0e6c-4e2b-996e-19e45a8d3693 service swift] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:16.837077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86372bc-0e6c-4e2b-996e-19e45a8d3693 service swift] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:16.896539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:16.897400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:16.897684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:16.897956 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] PATH_INFO: `/v3/projects/acae066a447040f98bf289109ed61c77` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:16.899152 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acae066a447040f98bf289109ed61c77)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:16.901080 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:16.945228 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acae066a447040f98bf289109ed61c77', 'request_id': 'req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:16.951342 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acae066a447040f98bf289109ed61c77', 'request_id': 'req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:16.957047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acae066a447040f98bf289109ed61c77', 'request_id': 'req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:16.969788 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] The token cache is being invalidate because project acae066a447040f98bf289109ed61c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:45:16.970083 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:16.970763 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-d3dc9c05-ac1a-4b9c-bca8-61c21d48d6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:45:16.972393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1378/2768] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:45:16 2022] DELETE /identity/v3/projects/acae066a447040f98bf289109ed61c77 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:16.977278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cffd3-8902-48c0-8918-460daba8a881 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:16.977567 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cffd3-8902-48c0-8918-460daba8a881 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:16.977844 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cffd3-8902-48c0-8918-460daba8a881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:16.995473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-5e6cffd3-8902-48c0-8918-460daba8a881 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:16.996700 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-5e6cffd3-8902-48c0-8918-460daba8a881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:17.054195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1391/2769] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:17.061826 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405b095-21c4-4097-9753-4d8b4c136065 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:17.062131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405b095-21c4-4097-9753-4d8b4c136065 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:17.062416 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405b095-21c4-4097-9753-4d8b4c136065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:17.080761 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-a405b095-21c4-4097-9753-4d8b4c136065 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:17.081900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a405b095-21c4-4097-9753-4d8b4c136065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:17.090119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1379/2770] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:17.094816 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cffd3-8902-48c0-8918-460daba8a881 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:17.104215 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cffd3-8902-48c0-8918-460daba8a881 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:17.108754 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bf7f5-21b1-4981-88a8-a627ab1bf731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:17.109396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bf7f5-21b1-4981-88a8-a627ab1bf731 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:17.109680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bf7f5-21b1-4981-88a8-a627ab1bf731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:17.109965 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bf7f5-21b1-4981-88a8-a627ab1bf731 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:17.110682 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bf7f5-21b1-4981-88a8-a627ab1bf731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:45:17.110984 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bf7f5-21b1-4981-88a8-a627ab1bf731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:17.112653 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bf7f5-21b1-4981-88a8-a627ab1bf731 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:17.123906 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1392/2771] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:45:17.128606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405b095-21c4-4097-9753-4d8b4c136065 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:17.138101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405b095-21c4-4097-9753-4d8b4c136065 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:17.143345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c604ea9-2365-4cba-b345-2821421b3a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:17.143983 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c604ea9-2365-4cba-b345-2821421b3a93 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:17.144264 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c604ea9-2365-4cba-b345-2821421b3a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:17.144695 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c604ea9-2365-4cba-b345-2821421b3a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:17.145390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c604ea9-2365-4cba-b345-2821421b3a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:17.147402 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c604ea9-2365-4cba-b345-2821421b3a93 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:17.171936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1380/2772] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:45:17 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:17.175926 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bf7f5-21b1-4981-88a8-a627ab1bf731 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:17.185618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bf7f5-21b1-4981-88a8-a627ab1bf731 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:17.238895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02be2c-c59f-47ec-883b-dcfdfada3ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:17.239587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02be2c-c59f-47ec-883b-dcfdfada3ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:17.239869 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02be2c-c59f-47ec-883b-dcfdfada3ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:17.240144 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02be2c-c59f-47ec-883b-dcfdfada3ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:17.240831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02be2c-c59f-47ec-883b-dcfdfada3ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:17.242781 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02be2c-c59f-47ec-883b-dcfdfada3ba3 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:17.264774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1393/2773] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:45:17 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:45:17.266761 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c604ea9-2365-4cba-b345-2821421b3a93 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:17.276880 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c604ea9-2365-4cba-b345-2821421b3a93 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:17.282045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3090c-6e3e-415c-9f57-a51a1de00097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:17.282888 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3090c-6e3e-415c-9f57-a51a1de00097 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:17.283222 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3090c-6e3e-415c-9f57-a51a1de00097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:17.283504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3090c-6e3e-415c-9f57-a51a1de00097 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:17.284236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3090c-6e3e-415c-9f57-a51a1de00097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:17.285834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3090c-6e3e-415c-9f57-a51a1de00097 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:17.296902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1381/2774] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:17.300792 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02be2c-c59f-47ec-883b-dcfdfada3ba3 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:17.311011 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02be2c-c59f-47ec-883b-dcfdfada3ba3 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:17.315749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8615752-b463-4eb4-bbfa-2fceec2d31ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:17.316405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615752-b463-4eb4-bbfa-2fceec2d31ec admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:17.316741 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615752-b463-4eb4-bbfa-2fceec2d31ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:17.317063 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8615752-b463-4eb4-bbfa-2fceec2d31ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:17.317904 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8615752-b463-4eb4-bbfa-2fceec2d31ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:17.319540 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8615752-b463-4eb4-bbfa-2fceec2d31ec admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:17.329772 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1394/2775] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:45:17.333998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3090c-6e3e-415c-9f57-a51a1de00097 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:17.344110 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3090c-6e3e-415c-9f57-a51a1de00097 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:17.349092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cd343-493c-4b6a-b39b-e9a5fe2f3056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:17.350091 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cd343-493c-4b6a-b39b-e9a5fe2f3056 admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:17.350465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cd343-493c-4b6a-b39b-e9a5fe2f3056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:17.350769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cd343-493c-4b6a-b39b-e9a5fe2f3056 admin admin] PATH_INFO: `/v3/projects/6aaff76c448b4ab3b083137b7cc7688c/users/f80bc1c473c1415c8442b5e51f8dd4db/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:17.365418 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cd343-493c-4b6a-b39b-e9a5fe2f3056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aaff76c448b4ab3b083137b7cc7688c, user_id=f80bc1c473c1415c8442b5e51f8dd4db, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:17.368104 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cd343-493c-4b6a-b39b-e9a5fe2f3056 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:17.380679 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1382/2776] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:45:17 2022] PUT /identity/v3/projects/6aaff76c448b4ab3b083137b7cc7688c/users/f80bc1c473c1415c8442b5e51f8dd4db/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:45:17.390377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905712f8-f700-46f0-a1cf-7f7442866cac None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:17.390668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905712f8-f700-46f0-a1cf-7f7442866cac None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:17.390968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905712f8-f700-46f0-a1cf-7f7442866cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:17.417056 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-905712f8-f700-46f0-a1cf-7f7442866cac None None] MFA Rules not processed for user `f80bc1c473c1415c8442b5e51f8dd4db`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:45:17.418269 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-905712f8-f700-46f0-a1cf-7f7442866cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:17.479973 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1395/2777] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:45:17.491794 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cd343-493c-4b6a-b39b-e9a5fe2f3056 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:17.493624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c69cd343-493c-4b6a-b39b-e9a5fe2f3056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:17.550991 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cd343-493c-4b6a-b39b-e9a5fe2f3056 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:17.554775 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6304fa-5f34-4c46-a2ee-607ca5ddf42c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10414e35df26406786eaf49c52661cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:17.555461 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6304fa-5f34-4c46-a2ee-607ca5ddf42c service glance] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:17.555749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6304fa-5f34-4c46-a2ee-607ca5ddf42c service glance] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:17.556029 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6304fa-5f34-4c46-a2ee-607ca5ddf42c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:17.564560 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6304fa-5f34-4c46-a2ee-607ca5ddf42c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:17.566017 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6304fa-5f34-4c46-a2ee-607ca5ddf42c service glance] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:17.575406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1383/2778] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:45:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:45:25.926509 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905712f8-f700-46f0-a1cf-7f7442866cac None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:45:25.927938 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-905712f8-f700-46f0-a1cf-7f7442866cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:26.018032 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905712f8-f700-46f0-a1cf-7f7442866cac None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:45:26.023489 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ebf90-f447-440b-82a6-9354c5dd540f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3004f3e4a9854502be59119e17e04961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:45:26.024166 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ebf90-f447-440b-82a6-9354c5dd540f service placement] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:45:26.024452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ebf90-f447-440b-82a6-9354c5dd540f service placement] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:45:26.024729 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ebf90-f447-440b-82a6-9354c5dd540f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:45:26.026585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8f0ebf90-f447-440b-82a6-9354c5dd540f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:45:26.039110 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ebf90-f447-440b-82a6-9354c5dd540f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:45:26.040698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ebf90-f447-440b-82a6-9354c5dd540f service placement] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:45:26.051145 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1396/2779] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:45:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:46:01.110472 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6304fa-5f34-4c46-a2ee-607ca5ddf42c service glance] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:01.171231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6304fa-5f34-4c46-a2ee-607ca5ddf42c service glance] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:01.175676 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:01.176531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:01.176807 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:01.177077 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] PATH_INFO: `/v3/users/f80bc1c473c1415c8442b5e51f8dd4db` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:01.178248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80bc1c473c1415c8442b5e51f8dd4db)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:01.180191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:01.222573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80bc1c473c1415c8442b5e51f8dd4db'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:01.223750 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80bc1c473c1415c8442b5e51f8dd4db'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:01.230238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80bc1c473c1415c8442b5e51f8dd4db'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:01.230862 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80bc1c473c1415c8442b5e51f8dd4db'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:01.237631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80bc1c473c1415c8442b5e51f8dd4db'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:01.254098 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1384/2780] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:46:01 2022] DELETE /identity/v3/users/f80bc1c473c1415c8442b5e51f8dd4db => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:46:01.259174 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f264e7-5339-43d1-8f1c-04ace353ea7c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:01.259686 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f264e7-5339-43d1-8f1c-04ace353ea7c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:01.259796 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f264e7-5339-43d1-8f1c-04ace353ea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:01.277483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b0f264e7-5339-43d1-8f1c-04ace353ea7c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:46:01.278668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b0f264e7-5339-43d1-8f1c-04ace353ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:01.334687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1397/2781] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:46:01.344256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:01.345683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:01.402672 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b5d1c-483f-4b47-b690-00f2b744e67c admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:01.406300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83a15-2eb2-48af-adc3-6e3bb5999db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:01.406948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83a15-2eb2-48af-adc3-6e3bb5999db2 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:01.407275 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83a15-2eb2-48af-adc3-6e3bb5999db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:01.407555 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83a15-2eb2-48af-adc3-6e3bb5999db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:01.416352 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb83a15-2eb2-48af-adc3-6e3bb5999db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:01.417782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb83a15-2eb2-48af-adc3-6e3bb5999db2 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:01.426936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1385/2782] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:46:01.685023 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f264e7-5339-43d1-8f1c-04ace353ea7c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:01.686516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b0f264e7-5339-43d1-8f1c-04ace353ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:01.699022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f264e7-5339-43d1-8f1c-04ace353ea7c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:01.703575 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:01.704439 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:01.704830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:01.705022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] PATH_INFO: `/v3/projects/6aaff76c448b4ab3b083137b7cc7688c` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:01.706238 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aaff76c448b4ab3b083137b7cc7688c)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:01.708206 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:01.752698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aaff76c448b4ab3b083137b7cc7688c', 'request_id': 'req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:01.761292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aaff76c448b4ab3b083137b7cc7688c', 'request_id': 'req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:01.766733 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aaff76c448b4ab3b083137b7cc7688c', 'request_id': 'req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:01.777287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] The token cache is being invalidate because project 6aaff76c448b4ab3b083137b7cc7688c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:46:01.777574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:01.778199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-e58ab6d8-88ec-4904-9b9f-4e35df2aacc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:01.779771 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1398/2783] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:46:01 2022] DELETE /identity/v3/projects/6aaff76c448b4ab3b083137b7cc7688c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:46:01.784755 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569346d-5f87-4ccb-a914-a536663ae1d5 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:01.785045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569346d-5f87-4ccb-a914-a536663ae1d5 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:01.785323 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4569346d-5f87-4ccb-a914-a536663ae1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:01.802829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-4569346d-5f87-4ccb-a914-a536663ae1d5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:46:01.804056 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-4569346d-5f87-4ccb-a914-a536663ae1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:01.861199 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1386/2784] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:46:01.869690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccc5f8-8e61-4618-89ae-9f342cd89fb6 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:01.869985 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccc5f8-8e61-4618-89ae-9f342cd89fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:01.870268 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccc5f8-8e61-4618-89ae-9f342cd89fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:01.888689 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-d6ccc5f8-8e61-4618-89ae-9f342cd89fb6 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:46:01.889898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d6ccc5f8-8e61-4618-89ae-9f342cd89fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:01.897843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1399/2785] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:46:01.901808 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569346d-5f87-4ccb-a914-a536663ae1d5 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:01.911440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4569346d-5f87-4ccb-a914-a536663ae1d5 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:01.916205 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883761cf-7dc3-4da7-ba75-bfd9c67b5071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:01.916863 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883761cf-7dc3-4da7-ba75-bfd9c67b5071 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:01.917151 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883761cf-7dc3-4da7-ba75-bfd9c67b5071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:01.917433 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883761cf-7dc3-4da7-ba75-bfd9c67b5071 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:01.918175 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883761cf-7dc3-4da7-ba75-bfd9c67b5071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:46:01.918486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883761cf-7dc3-4da7-ba75-bfd9c67b5071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:01.920129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883761cf-7dc3-4da7-ba75-bfd9c67b5071 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:01.932146 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1387/2786] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:46:01.936116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccc5f8-8e61-4618-89ae-9f342cd89fb6 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:01.945780 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccc5f8-8e61-4618-89ae-9f342cd89fb6 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:01.950436 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d69d01-217d-4d70-a88b-347f57fe5609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:01.951146 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d69d01-217d-4d70-a88b-347f57fe5609 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:01.951434 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d69d01-217d-4d70-a88b-347f57fe5609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:01.951712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d69d01-217d-4d70-a88b-347f57fe5609 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:01.952411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d69d01-217d-4d70-a88b-347f57fe5609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:01.954353 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d69d01-217d-4d70-a88b-347f57fe5609 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:01.983105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1400/2787] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:46:01 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:46:01.984378 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883761cf-7dc3-4da7-ba75-bfd9c67b5071 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:01.995255 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883761cf-7dc3-4da7-ba75-bfd9c67b5071 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:02.049160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef397abc-d100-452b-b26d-16c1dc501ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:02.049755 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef397abc-d100-452b-b26d-16c1dc501ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:02.050039 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef397abc-d100-452b-b26d-16c1dc501ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:02.050312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef397abc-d100-452b-b26d-16c1dc501ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:02.050998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef397abc-d100-452b-b26d-16c1dc501ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:02.053537 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef397abc-d100-452b-b26d-16c1dc501ec0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:02.072191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1388/2788] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:46:01 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:46:02.076192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d69d01-217d-4d70-a88b-347f57fe5609 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:02.086175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d69d01-217d-4d70-a88b-347f57fe5609 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:02.090768 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656be19-ddcb-43dc-8bcb-899efc3a2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:02.091452 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656be19-ddcb-43dc-8bcb-899efc3a2962 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:02.091736 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656be19-ddcb-43dc-8bcb-899efc3a2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:02.092013 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656be19-ddcb-43dc-8bcb-899efc3a2962 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:02.092738 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656be19-ddcb-43dc-8bcb-899efc3a2962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:02.094335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656be19-ddcb-43dc-8bcb-899efc3a2962 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:02.104881 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1401/2789] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:46:02.108551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef397abc-d100-452b-b26d-16c1dc501ec0 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:02.119134 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef397abc-d100-452b-b26d-16c1dc501ec0 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:02.123770 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ed8e0-1444-41ab-b040-8ff39aa5b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:02.124425 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed8e0-1444-41ab-b040-8ff39aa5b48a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:02.124710 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed8e0-1444-41ab-b040-8ff39aa5b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:02.124993 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed8e0-1444-41ab-b040-8ff39aa5b48a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:02.125722 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ed8e0-1444-41ab-b040-8ff39aa5b48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:02.127326 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ed8e0-1444-41ab-b040-8ff39aa5b48a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:02.137005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1389/2790] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:46:02.140850 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656be19-ddcb-43dc-8bcb-899efc3a2962 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:02.150465 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656be19-ddcb-43dc-8bcb-899efc3a2962 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:02.155005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1af467-22c2-4bfc-a735-f24ac9e1fcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:02.155894 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1af467-22c2-4bfc-a735-f24ac9e1fcf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:02.156178 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1af467-22c2-4bfc-a735-f24ac9e1fcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:02.156448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1af467-22c2-4bfc-a735-f24ac9e1fcf7 admin admin] PATH_INFO: `/v3/projects/06b05ed5c7684235a34998f9b650f397/users/1538430e13bd484db1a1bf0b37faecc8/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:02.170785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1af467-22c2-4bfc-a735-f24ac9e1fcf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b05ed5c7684235a34998f9b650f397, user_id=1538430e13bd484db1a1bf0b37faecc8, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:02.173502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1af467-22c2-4bfc-a735-f24ac9e1fcf7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:02.185898 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1402/2791] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:46:02 2022] PUT /identity/v3/projects/06b05ed5c7684235a34998f9b650f397/users/1538430e13bd484db1a1bf0b37faecc8/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:46:02.196101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1fa9b-157e-46b0-bc10-c9639442d968 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:02.196427 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1fa9b-157e-46b0-bc10-c9639442d968 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:02.196713 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1fa9b-157e-46b0-bc10-c9639442d968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:02.222302 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-24a1fa9b-157e-46b0-bc10-c9639442d968 None None] MFA Rules not processed for user `1538430e13bd484db1a1bf0b37faecc8`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:46:02.224109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-24a1fa9b-157e-46b0-bc10-c9639442d968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:02.291094 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1390/2792] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:46:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:46:02.302535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1af467-22c2-4bfc-a735-f24ac9e1fcf7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:02.304207 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-8a1af467-22c2-4bfc-a735-f24ac9e1fcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:02.360039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1af467-22c2-4bfc-a735-f24ac9e1fcf7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:02.363695 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a6fcb-c04e-43a8-bf51-38f93d26f1db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:02.364318 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6fcb-c04e-43a8-bf51-38f93d26f1db service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:02.364603 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6fcb-c04e-43a8-bf51-38f93d26f1db service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:02.364878 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6fcb-c04e-43a8-bf51-38f93d26f1db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:02.373391 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a6fcb-c04e-43a8-bf51-38f93d26f1db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:02.374813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a6fcb-c04e-43a8-bf51-38f93d26f1db service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:02.383616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1403/2793] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:46:23.553292 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1fa9b-157e-46b0-bc10-c9639442d968 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:23.614263 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1fa9b-157e-46b0-bc10-c9639442d968 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:23.618948 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:23.619834 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:23.620119 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:23.620396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] PATH_INFO: `/v3/users/1538430e13bd484db1a1bf0b37faecc8` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:23.621573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1538430e13bd484db1a1bf0b37faecc8)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:23.623509 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:23.667890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1538430e13bd484db1a1bf0b37faecc8'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:23.668531 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1538430e13bd484db1a1bf0b37faecc8'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:23.675117 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1538430e13bd484db1a1bf0b37faecc8'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:23.675749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1538430e13bd484db1a1bf0b37faecc8'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:23.682845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1538430e13bd484db1a1bf0b37faecc8'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:23.699546 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1391/2794] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:46:23 2022] DELETE /identity/v3/users/1538430e13bd484db1a1bf0b37faecc8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:46:23.704007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d584b-7b2d-4d36-8b6a-8d31fdcc6b6a None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:23.704516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d584b-7b2d-4d36-8b6a-8d31fdcc6b6a None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:23.704623 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d584b-7b2d-4d36-8b6a-8d31fdcc6b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:23.721988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-e34d584b-7b2d-4d36-8b6a-8d31fdcc6b6a None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:46:23.723291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e34d584b-7b2d-4d36-8b6a-8d31fdcc6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:23.779776 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1404/2795] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:46:23.789251 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:23.790664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:23.846068 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562670f2-e278-407e-bf2f-b507e2594926 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:23.849875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4a062-e9cc-4524-a691-ab05153dbc12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:23.850512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4a062-e9cc-4524-a691-ab05153dbc12 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:23.850820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4a062-e9cc-4524-a691-ab05153dbc12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:23.851126 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4a062-e9cc-4524-a691-ab05153dbc12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:23.859875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4a062-e9cc-4524-a691-ab05153dbc12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:23.861294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4a062-e9cc-4524-a691-ab05153dbc12 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:23.871379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1392/2796] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:46:24.127595 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d584b-7b2d-4d36-8b6a-8d31fdcc6b6a None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:24.129411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-e34d584b-7b2d-4d36-8b6a-8d31fdcc6b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:24.142492 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d584b-7b2d-4d36-8b6a-8d31fdcc6b6a None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:24.147582 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:24.148445 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:24.148727 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:24.149003 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] PATH_INFO: `/v3/projects/06b05ed5c7684235a34998f9b650f397` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:24.150310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b05ed5c7684235a34998f9b650f397)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:24.152449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:24.200195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b05ed5c7684235a34998f9b650f397', 'request_id': 'req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:24.206862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b05ed5c7684235a34998f9b650f397', 'request_id': 'req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:24.212228 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b05ed5c7684235a34998f9b650f397', 'request_id': 'req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:24.222833 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] The token cache is being invalidate because project 06b05ed5c7684235a34998f9b650f397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:46:24.223149 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:24.223775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:46:24.225320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1405/2797] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:46:24 2022] DELETE /identity/v3/projects/06b05ed5c7684235a34998f9b650f397 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:46:35.877625 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4a062-e9cc-4524-a691-ab05153dbc12 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:35.879022 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d8f4a062-e9cc-4524-a691-ab05153dbc12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:35.938220 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4a062-e9cc-4524-a691-ab05153dbc12 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:35.985259 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e293962-67d5-433e-b71a-62d43d768a92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:35.985911 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293962-67d5-433e-b71a-62d43d768a92 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:35.986190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293962-67d5-433e-b71a-62d43d768a92 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:35.986462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e293962-67d5-433e-b71a-62d43d768a92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:35.988294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-3e293962-67d5-433e-b71a-62d43d768a92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:36.044524 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e293962-67d5-433e-b71a-62d43d768a92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:36.045946 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e293962-67d5-433e-b71a-62d43d768a92 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:36.055178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1393/2798] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:46:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:46:36.379289 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:36.381279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:36.436304 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac229-bc68-4e7a-bfca-b9e9bd9ee9b0 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:36.439822 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97229f1-3bf6-48f3-9e45-fd1f0034ac44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:36.440466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97229f1-3bf6-48f3-9e45-fd1f0034ac44 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:36.440747 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97229f1-3bf6-48f3-9e45-fd1f0034ac44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:36.441022 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97229f1-3bf6-48f3-9e45-fd1f0034ac44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:36.443387 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a97229f1-3bf6-48f3-9e45-fd1f0034ac44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:36.531181 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97229f1-3bf6-48f3-9e45-fd1f0034ac44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:36.532629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97229f1-3bf6-48f3-9e45-fd1f0034ac44 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:36.553393 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1406/2799] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:46:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:46:37.735447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e293962-67d5-433e-b71a-62d43d768a92 service cinder] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:37.746085 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e293962-67d5-433e-b71a-62d43d768a92 service cinder] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:37.749841 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15772ff0-57a3-4a47-a739-fd0004729060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:37.750573 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772ff0-57a3-4a47-a739-fd0004729060 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:37.750920 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772ff0-57a3-4a47-a739-fd0004729060 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:37.751288 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15772ff0-57a3-4a47-a739-fd0004729060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:37.753066 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-15772ff0-57a3-4a47-a739-fd0004729060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:37.770565 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15772ff0-57a3-4a47-a739-fd0004729060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:37.772037 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15772ff0-57a3-4a47-a739-fd0004729060 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:37.783231 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1394/2800] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:46:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:46:42.030971 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a58ce6-29b0-4b57-8ab6-b0c8d1885c78 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:42.031573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a58ce6-29b0-4b57-8ab6-b0c8d1885c78 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:42.031573 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a58ce6-29b0-4b57-8ab6-b0c8d1885c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:42.048497 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-45a58ce6-29b0-4b57-8ab6-b0c8d1885c78 None None] MFA Rules not processed for user `5ea3990cf736495ea612f1f5ed4f8674`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:46:42.049712 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-45a58ce6-29b0-4b57-8ab6-b0c8d1885c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:42.057018 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1407/2801] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:46:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:46:44.437936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15772ff0-57a3-4a47-a739-fd0004729060 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:46:44.447633 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15772ff0-57a3-4a47-a739-fd0004729060 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:46:44.451324 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9dfd-6d58-43bc-80f3-9b09f2d5ed82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:46:44.451972 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9dfd-6d58-43bc-80f3-9b09f2d5ed82 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:46:44.452253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9dfd-6d58-43bc-80f3-9b09f2d5ed82 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:46:44.452530 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd9dfd-6d58-43bc-80f3-9b09f2d5ed82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:46:44.454281 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cbfd9dfd-6d58-43bc-80f3-9b09f2d5ed82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:46:44.465113 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9dfd-6d58-43bc-80f3-9b09f2d5ed82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:46:44.466604 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd9dfd-6d58-43bc-80f3-9b09f2d5ed82 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:46:44.476078 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1395/2802] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:46:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:35.565005 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a58ce6-29b0-4b57-8ab6-b0c8d1885c78 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:35.566462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-45a58ce6-29b0-4b57-8ab6-b0c8d1885c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:35.582448 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a58ce6-29b0-4b57-8ab6-b0c8d1885c78 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:35.588012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9858902-3ddd-4c74-a96e-8ab80297ac10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2366609a0a564e7fbcb05b503de78580', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:35.588672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858902-3ddd-4c74-a96e-8ab80297ac10 service nova] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:35.588960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858902-3ddd-4c74-a96e-8ab80297ac10 service nova] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:35.589841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9858902-3ddd-4c74-a96e-8ab80297ac10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:35.591730 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a9858902-3ddd-4c74-a96e-8ab80297ac10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:35.605544 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9858902-3ddd-4c74-a96e-8ab80297ac10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:35.607190 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9858902-3ddd-4c74-a96e-8ab80297ac10 service nova] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:35.623221 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1408/2803] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:48:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:41.295158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9dfd-6d58-43bc-80f3-9b09f2d5ed82 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:41.296547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-cbfd9dfd-6d58-43bc-80f3-9b09f2d5ed82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:41.306728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd9dfd-6d58-43bc-80f3-9b09f2d5ed82 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:41.310678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73f97f-9373-401e-83eb-d1a9ba16d0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:41.311360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f97f-9373-401e-83eb-d1a9ba16d0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:41.311651 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f97f-9373-401e-83eb-d1a9ba16d0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:41.311928 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73f97f-9373-401e-83eb-d1a9ba16d0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:41.313663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-ca73f97f-9373-401e-83eb-d1a9ba16d0a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:41.373790 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73f97f-9373-401e-83eb-d1a9ba16d0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:41.375250 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73f97f-9373-401e-83eb-d1a9ba16d0a3 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:41.384563 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1396/2804] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:44.776287 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9858902-3ddd-4c74-a96e-8ab80297ac10 service nova] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:44.778310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a9858902-3ddd-4c74-a96e-8ab80297ac10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:44.791974 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9858902-3ddd-4c74-a96e-8ab80297ac10 service nova] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:44.797170 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:44.798026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:44.798330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:44.798591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] PATH_INFO: `/v3/users/5ea3990cf736495ea612f1f5ed4f8674` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:44.799839 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea3990cf736495ea612f1f5ed4f8674)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:44.801778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:44.845616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea3990cf736495ea612f1f5ed4f8674'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:44.852557 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea3990cf736495ea612f1f5ed4f8674'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:44.853241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea3990cf736495ea612f1f5ed4f8674'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:44.853855 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea3990cf736495ea612f1f5ed4f8674'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:44.865843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-493e94bf-ce52-41f6-a348-9fa053eac69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea3990cf736495ea612f1f5ed4f8674'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:44.877503 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1409/2805] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:48:44 2022] DELETE /identity/v3/users/5ea3990cf736495ea612f1f5ed4f8674 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:45.055276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73f97f-9373-401e-83eb-d1a9ba16d0a3 service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.065373 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73f97f-9373-401e-83eb-d1a9ba16d0a3 service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.122178 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.123055 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.123351 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.123634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] PATH_INFO: `/v3/projects/38fdbe6cacb8487087950884b752b21d` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.124822 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=38fdbe6cacb8487087950884b752b21d)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:45.126747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:45.170813 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38fdbe6cacb8487087950884b752b21d', 'request_id': 'req-98495e3f-801e-41a5-a790-805f206ad2eb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:45.176734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38fdbe6cacb8487087950884b752b21d', 'request_id': 'req-98495e3f-801e-41a5-a790-805f206ad2eb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:45.182102 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38fdbe6cacb8487087950884b752b21d', 'request_id': 'req-98495e3f-801e-41a5-a790-805f206ad2eb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:45.193938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] The token cache is being invalidate because project 38fdbe6cacb8487087950884b752b21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:48:45.194227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:45.194847 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98495e3f-801e-41a5-a790-805f206ad2eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:48:45.196400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1397/2806] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:48:45 2022] DELETE /identity/v3/projects/38fdbe6cacb8487087950884b752b21d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:45.201895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016163b-40d0-4896-b70a-b9d3d8794279 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.202192 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016163b-40d0-4896-b70a-b9d3d8794279 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.202476 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016163b-40d0-4896-b70a-b9d3d8794279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.221043 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-a016163b-40d0-4896-b70a-b9d3d8794279 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:45.222245 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a016163b-40d0-4896-b70a-b9d3d8794279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:45.280951 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1410/2807] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:45.289311 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a0c74-ac03-412a-8c8a-0c3c74f8e79c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.289624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a0c74-ac03-412a-8c8a-0c3c74f8e79c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.289889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a0c74-ac03-412a-8c8a-0c3c74f8e79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.312702 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-617a0c74-ac03-412a-8c8a-0c3c74f8e79c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:45.313929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-617a0c74-ac03-412a-8c8a-0c3c74f8e79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:45.322081 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1398/2808] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:45.326441 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016163b-40d0-4896-b70a-b9d3d8794279 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.337541 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016163b-40d0-4896-b70a-b9d3d8794279 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.343841 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1e5a6-0727-4556-93a3-45250975d337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.344513 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1e5a6-0727-4556-93a3-45250975d337 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.344801 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1e5a6-0727-4556-93a3-45250975d337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.345078 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1e5a6-0727-4556-93a3-45250975d337 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.345821 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1e5a6-0727-4556-93a3-45250975d337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:48:45.346132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1e5a6-0727-4556-93a3-45250975d337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:45.347807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1e5a6-0727-4556-93a3-45250975d337 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:45.360092 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1411/2809] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 12 14:48:45.364467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a0c74-ac03-412a-8c8a-0c3c74f8e79c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.373757 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a0c74-ac03-412a-8c8a-0c3c74f8e79c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.378447 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff10fb-5be8-474a-bf8c-25a7e257a5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.379133 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff10fb-5be8-474a-bf8c-25a7e257a5fa admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.379417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff10fb-5be8-474a-bf8c-25a7e257a5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.379691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff10fb-5be8-474a-bf8c-25a7e257a5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.380383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff10fb-5be8-474a-bf8c-25a7e257a5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:45.382267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff10fb-5be8-474a-bf8c-25a7e257a5fa admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:45.416183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1399/2810] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:48:45 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:45.420775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1e5a6-0727-4556-93a3-45250975d337 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.431870 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1e5a6-0727-4556-93a3-45250975d337 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.493276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324e5a1-e1d0-4b23-a963-90fb69cf2c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.493955 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324e5a1-e1d0-4b23-a963-90fb69cf2c80 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.494243 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324e5a1-e1d0-4b23-a963-90fb69cf2c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.494522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324e5a1-e1d0-4b23-a963-90fb69cf2c80 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.495272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324e5a1-e1d0-4b23-a963-90fb69cf2c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:45.497244 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324e5a1-e1d0-4b23-a963-90fb69cf2c80 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:45.517343 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1412/2811] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:48:45 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:45.521481 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff10fb-5be8-474a-bf8c-25a7e257a5fa admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.532131 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff10fb-5be8-474a-bf8c-25a7e257a5fa admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.536734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ace95-7727-452d-b9f4-9e3071c22d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.537393 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ace95-7727-452d-b9f4-9e3071c22d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.537673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ace95-7727-452d-b9f4-9e3071c22d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.537947 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ace95-7727-452d-b9f4-9e3071c22d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.538666 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ace95-7727-452d-b9f4-9e3071c22d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:45.540290 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ace95-7727-452d-b9f4-9e3071c22d07 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:45.554464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1400/2812] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 12 14:48:45.556442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324e5a1-e1d0-4b23-a963-90fb69cf2c80 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.566463 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324e5a1-e1d0-4b23-a963-90fb69cf2c80 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.571176 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639052f2-67be-4bde-8349-0144577aa944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.571830 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639052f2-67be-4bde-8349-0144577aa944 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.572118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639052f2-67be-4bde-8349-0144577aa944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.572398 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639052f2-67be-4bde-8349-0144577aa944 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.573123 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639052f2-67be-4bde-8349-0144577aa944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:45.574819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639052f2-67be-4bde-8349-0144577aa944 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:45.584900 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1413/2813] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:45.588760 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ace95-7727-452d-b9f4-9e3071c22d07 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.599125 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ace95-7727-452d-b9f4-9e3071c22d07 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.603767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63392a34-b308-42fe-afeb-374674fce44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.604634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63392a34-b308-42fe-afeb-374674fce44a admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.604919 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63392a34-b308-42fe-afeb-374674fce44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.605202 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63392a34-b308-42fe-afeb-374674fce44a admin admin] PATH_INFO: `/v3/projects/58b14d7c3fa042ffaf15593ad1eb9498/users/92ae8aea581a4b05b1cc8457f09a2ecb/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.620741 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63392a34-b308-42fe-afeb-374674fce44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b14d7c3fa042ffaf15593ad1eb9498, user_id=92ae8aea581a4b05b1cc8457f09a2ecb, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:45.623431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63392a34-b308-42fe-afeb-374674fce44a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:45.644617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1401/2814] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:48:45 2022] PUT /identity/v3/projects/58b14d7c3fa042ffaf15593ad1eb9498/users/92ae8aea581a4b05b1cc8457f09a2ecb/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:45.655420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1706a-d945-419f-a3b2-b5ba1fac6cfa None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.655820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1706a-d945-419f-a3b2-b5ba1fac6cfa None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.656107 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1706a-d945-419f-a3b2-b5ba1fac6cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.682774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-01f1706a-d945-419f-a3b2-b5ba1fac6cfa None None] MFA Rules not processed for user `92ae8aea581a4b05b1cc8457f09a2ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:45.684034 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-01f1706a-d945-419f-a3b2-b5ba1fac6cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:45.746502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1414/2815] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:45.750978 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63392a34-b308-42fe-afeb-374674fce44a admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.811699 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63392a34-b308-42fe-afeb-374674fce44a admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.816586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d96ad-809d-49fb-a362-b408cfcb2be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.817180 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d96ad-809d-49fb-a362-b408cfcb2be8 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.817459 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d96ad-809d-49fb-a362-b408cfcb2be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.817734 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d96ad-809d-49fb-a362-b408cfcb2be8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.818417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d96ad-809d-49fb-a362-b408cfcb2be8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:45.820336 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d96ad-809d-49fb-a362-b408cfcb2be8 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:45.847787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1402/2816] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:48:45 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:48:45.849130 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1706a-d945-419f-a3b2-b5ba1fac6cfa None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.859791 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1706a-d945-419f-a3b2-b5ba1fac6cfa None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.917551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db0457-b007-44ef-97b5-65265839cdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.918272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db0457-b007-44ef-97b5-65265839cdff admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.918554 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db0457-b007-44ef-97b5-65265839cdff admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.918824 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db0457-b007-44ef-97b5-65265839cdff admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.919551 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db0457-b007-44ef-97b5-65265839cdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:45.921466 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db0457-b007-44ef-97b5-65265839cdff admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:45.943782 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1415/2817] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:48:45 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:48:45.945011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d96ad-809d-49fb-a362-b408cfcb2be8 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.955725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d96ad-809d-49fb-a362-b408cfcb2be8 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.960526 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463b49a-b88f-4141-a327-3ff088f2d21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.961194 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463b49a-b88f-4141-a327-3ff088f2d21e admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.961617 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463b49a-b88f-4141-a327-3ff088f2d21e admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.961902 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463b49a-b88f-4141-a327-3ff088f2d21e admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:45.962663 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463b49a-b88f-4141-a327-3ff088f2d21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:45.964371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463b49a-b88f-4141-a327-3ff088f2d21e admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:45.975448 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1403/2818] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:45.979512 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db0457-b007-44ef-97b5-65265839cdff admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:45.989194 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db0457-b007-44ef-97b5-65265839cdff admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:45.994017 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aff307-2ea7-49dc-998b-7f87224a22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:45.994880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aff307-2ea7-49dc-998b-7f87224a22bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:45.995199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aff307-2ea7-49dc-998b-7f87224a22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:45.995473 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aff307-2ea7-49dc-998b-7f87224a22bc admin admin] PATH_INFO: `/v3/projects/2ff9d9b57e964c3ca9dabf97abd1f3b9/users/6cf436d3cabe49229a9d9f179de18cff/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.010195 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aff307-2ea7-49dc-998b-7f87224a22bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff9d9b57e964c3ca9dabf97abd1f3b9, user_id=6cf436d3cabe49229a9d9f179de18cff, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:46.014134 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aff307-2ea7-49dc-998b-7f87224a22bc admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:46.027095 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1416/2819] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:48:45 2022] PUT /identity/v3/projects/2ff9d9b57e964c3ca9dabf97abd1f3b9/users/6cf436d3cabe49229a9d9f179de18cff/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:46.031124 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463b49a-b88f-4141-a327-3ff088f2d21e admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:46.040728 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463b49a-b88f-4141-a327-3ff088f2d21e admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:46.094169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13543be-e639-4285-9da1-4b97f32189df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:46.094840 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13543be-e639-4285-9da1-4b97f32189df admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.095157 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13543be-e639-4285-9da1-4b97f32189df admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.095430 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13543be-e639-4285-9da1-4b97f32189df admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.096186 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13543be-e639-4285-9da1-4b97f32189df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:46.097786 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13543be-e639-4285-9da1-4b97f32189df admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:46.107422 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1404/2820] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:48:46.111634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aff307-2ea7-49dc-998b-7f87224a22bc admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:46.122608 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aff307-2ea7-49dc-998b-7f87224a22bc admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:46.127380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa13dec-cb0c-474d-9860-d51b19501e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:46.128253 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa13dec-cb0c-474d-9860-d51b19501e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.128539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa13dec-cb0c-474d-9860-d51b19501e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.128813 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa13dec-cb0c-474d-9860-d51b19501e60 admin admin] PATH_INFO: `/v3/projects/2ff9d9b57e964c3ca9dabf97abd1f3b9/users/6cf436d3cabe49229a9d9f179de18cff/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.130799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa13dec-cb0c-474d-9860-d51b19501e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff9d9b57e964c3ca9dabf97abd1f3b9, user_id=6cf436d3cabe49229a9d9f179de18cff, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:46.133482 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa13dec-cb0c-474d-9860-d51b19501e60 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:46.144057 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1417/2821] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:48:46 2022] PUT /identity/v3/projects/2ff9d9b57e964c3ca9dabf97abd1f3b9/users/6cf436d3cabe49229a9d9f179de18cff/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:48:46.155369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce52950-59ef-4924-b7f0-8efeda65c047 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.155683 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce52950-59ef-4924-b7f0-8efeda65c047 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.155966 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce52950-59ef-4924-b7f0-8efeda65c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.180943 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-2ce52950-59ef-4924-b7f0-8efeda65c047 None None] MFA Rules not processed for user `6cf436d3cabe49229a9d9f179de18cff`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:48:46.182148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-2ce52950-59ef-4924-b7f0-8efeda65c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:46.249248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1405/2822] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:48:46.260517 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa13dec-cb0c-474d-9860-d51b19501e60 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:46.262831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-baa13dec-cb0c-474d-9860-d51b19501e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:48:46.317665 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa13dec-cb0c-474d-9860-d51b19501e60 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:46.321327 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcadef6-d07e-4ea8-89a0-bb4ae1138edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:46.321966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcadef6-d07e-4ea8-89a0-bb4ae1138edd service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.322248 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcadef6-d07e-4ea8-89a0-bb4ae1138edd service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.322524 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcadef6-d07e-4ea8-89a0-bb4ae1138edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.331940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcadef6-d07e-4ea8-89a0-bb4ae1138edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:46.333365 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcadef6-d07e-4ea8-89a0-bb4ae1138edd service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:46.342535 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1418/2823] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:48:46.413276 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce52950-59ef-4924-b7f0-8efeda65c047 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:48:46.423793 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce52950-59ef-4924-b7f0-8efeda65c047 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:48:46.427464 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6883e-3153-4cb3-9485-b6a9f877d88b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:48:46.428105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6883e-3153-4cb3-9485-b6a9f877d88b service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:48:46.428389 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6883e-3153-4cb3-9485-b6a9f877d88b service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:48:46.428664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6883e-3153-4cb3-9485-b6a9f877d88b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:48:46.483643 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6883e-3153-4cb3-9485-b6a9f877d88b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:48:46.485173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6883e-3153-4cb3-9485-b6a9f877d88b service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:48:46.494025 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1406/2824] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:28.382662 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcadef6-d07e-4ea8-89a0-bb4ae1138edd service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:28.443681 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcadef6-d07e-4ea8-89a0-bb4ae1138edd service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:28.448273 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:28.449131 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:28.449417 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:28.449693 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] PATH_INFO: `/v3/users/92ae8aea581a4b05b1cc8457f09a2ecb` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:28.451432 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ae8aea581a4b05b1cc8457f09a2ecb)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:28.453361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:28.498742 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ae8aea581a4b05b1cc8457f09a2ecb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:28.505345 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ae8aea581a4b05b1cc8457f09a2ecb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:28.505988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ae8aea581a4b05b1cc8457f09a2ecb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:28.506589 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ae8aea581a4b05b1cc8457f09a2ecb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:28.518335 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ae8aea581a4b05b1cc8457f09a2ecb'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:28.531483 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1419/2825] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:49:28 2022] DELETE /identity/v3/users/92ae8aea581a4b05b1cc8457f09a2ecb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:28.536031 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13b9fc-486f-407a-8672-2d9a085654a7 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:28.536533 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13b9fc-486f-407a-8672-2d9a085654a7 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:28.536648 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13b9fc-486f-407a-8672-2d9a085654a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:28.553300 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-bb13b9fc-486f-407a-8672-2d9a085654a7 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:28.554494 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bb13b9fc-486f-407a-8672-2d9a085654a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:28.618215 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1407/2826] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:28.627819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:28.629198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:28.684117 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca802f-91b8-42d1-a5de-4356c74f8cd6 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:28.688272 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070c89-6cc4-40d0-89f4-9d3d29a74e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:28.688911 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070c89-6cc4-40d0-89f4-9d3d29a74e33 service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:28.689193 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070c89-6cc4-40d0-89f4-9d3d29a74e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:28.689469 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66070c89-6cc4-40d0-89f4-9d3d29a74e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:28.698219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66070c89-6cc4-40d0-89f4-9d3d29a74e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:28.699683 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66070c89-6cc4-40d0-89f4-9d3d29a74e33 service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:28.710076 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1420/2827] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:28.973580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13b9fc-486f-407a-8672-2d9a085654a7 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:28.975011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-bb13b9fc-486f-407a-8672-2d9a085654a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:28.986748 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13b9fc-486f-407a-8672-2d9a085654a7 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:28.991369 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:28.992502 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:28.992782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:28.993058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] PATH_INFO: `/v3/projects/58b14d7c3fa042ffaf15593ad1eb9498` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:28.994280 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b14d7c3fa042ffaf15593ad1eb9498)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:28.996253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:29.041985 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b14d7c3fa042ffaf15593ad1eb9498', 'request_id': 'req-98ed94a0-1fea-4955-91f0-3974bbcfd719'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.048542 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b14d7c3fa042ffaf15593ad1eb9498', 'request_id': 'req-98ed94a0-1fea-4955-91f0-3974bbcfd719'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.054032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b14d7c3fa042ffaf15593ad1eb9498', 'request_id': 'req-98ed94a0-1fea-4955-91f0-3974bbcfd719'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.067155 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] The token cache is being invalidate because project 58b14d7c3fa042ffaf15593ad1eb9498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:29.067444 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.068053 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.069606 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1408/2828] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:49:28 2022] DELETE /identity/v3/projects/58b14d7c3fa042ffaf15593ad1eb9498 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:29.073626 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070c89-6cc4-40d0-89f4-9d3d29a74e33 service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:29.083124 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66070c89-6cc4-40d0-89f4-9d3d29a74e33 service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:29.142834 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:29.143728 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:29.144011 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:29.144284 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] PATH_INFO: `/v3/users/6cf436d3cabe49229a9d9f179de18cff` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:29.145490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf436d3cabe49229a9d9f179de18cff)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:29.147516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:29.192562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf436d3cabe49229a9d9f179de18cff'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.198960 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf436d3cabe49229a9d9f179de18cff'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.199635 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf436d3cabe49229a9d9f179de18cff'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.200231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf436d3cabe49229a9d9f179de18cff'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.211336 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-da9f3c11-cf32-47c9-b980-92417b4117b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf436d3cabe49229a9d9f179de18cff'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.233817 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1421/2829] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:49:29 2022] DELETE /identity/v3/users/6cf436d3cabe49229a9d9f179de18cff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:29.491390 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:29.493123 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:29.506103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed94a0-1fea-4955-91f0-3974bbcfd719 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:29.562207 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:29.563109 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:29.563396 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:29.563673 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] PATH_INFO: `/v3/projects/2ff9d9b57e964c3ca9dabf97abd1f3b9` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:29.564860 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff9d9b57e964c3ca9dabf97abd1f3b9)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:29.566782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:29.612998 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff9d9b57e964c3ca9dabf97abd1f3b9', 'request_id': 'req-03b9c124-fbc1-483e-bacf-3de68540b11d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.619050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff9d9b57e964c3ca9dabf97abd1f3b9', 'request_id': 'req-03b9c124-fbc1-483e-bacf-3de68540b11d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.624334 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff9d9b57e964c3ca9dabf97abd1f3b9', 'request_id': 'req-03b9c124-fbc1-483e-bacf-3de68540b11d'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.636887 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] The token cache is being invalidate because project 2ff9d9b57e964c3ca9dabf97abd1f3b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:29.637182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.637820 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-03b9c124-fbc1-483e-bacf-3de68540b11d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:29.639408 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1409/2830] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:49:29 2022] DELETE /identity/v3/projects/2ff9d9b57e964c3ca9dabf97abd1f3b9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:49:29.644467 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734378b-9c17-430b-a12b-ffc12e85cefe None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:29.644967 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734378b-9c17-430b-a12b-ffc12e85cefe None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:29.645146 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734378b-9c17-430b-a12b-ffc12e85cefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:29.663806 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6734378b-9c17-430b-a12b-ffc12e85cefe None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:29.665019 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6734378b-9c17-430b-a12b-ffc12e85cefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:29.720940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1422/2831] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:29.728507 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9245db-7cd9-4d3c-97bf-6010f5b04625 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:29.728797 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9245db-7cd9-4d3c-97bf-6010f5b04625 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:29.729103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9245db-7cd9-4d3c-97bf-6010f5b04625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:29.747664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-5d9245db-7cd9-4d3c-97bf-6010f5b04625 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:29.748853 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5d9245db-7cd9-4d3c-97bf-6010f5b04625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:29.756595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1410/2832] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:29.760659 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734378b-9c17-430b-a12b-ffc12e85cefe None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:29.770276 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734378b-9c17-430b-a12b-ffc12e85cefe None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:29.774988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efea72a-d3ff-4370-b6b3-6f81729a8833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:29.775674 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea72a-d3ff-4370-b6b3-6f81729a8833 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:29.775959 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea72a-d3ff-4370-b6b3-6f81729a8833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:29.776241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea72a-d3ff-4370-b6b3-6f81729a8833 admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:29.776969 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efea72a-d3ff-4370-b6b3-6f81729a8833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:49:29.777281 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efea72a-d3ff-4370-b6b3-6f81729a8833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:29.779437 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efea72a-d3ff-4370-b6b3-6f81729a8833 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:29.790877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1423/2833] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:49:29.795452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9245db-7cd9-4d3c-97bf-6010f5b04625 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:29.804386 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9245db-7cd9-4d3c-97bf-6010f5b04625 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:29.809333 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3ebea-cf0a-4d81-b57d-3950c9dca0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:29.810024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ebea-cf0a-4d81-b57d-3950c9dca0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:29.810309 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ebea-cf0a-4d81-b57d-3950c9dca0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:29.810587 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3ebea-cf0a-4d81-b57d-3950c9dca0c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:29.811314 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3ebea-cf0a-4d81-b57d-3950c9dca0c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:29.813216 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3ebea-cf0a-4d81-b57d-3950c9dca0c3 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:29.840190 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1411/2834] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:49:29 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:29.848999 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efea72a-d3ff-4370-b6b3-6f81729a8833 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:29.859403 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efea72a-d3ff-4370-b6b3-6f81729a8833 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:29.915283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4e31b-2951-4b6d-a6db-0ec90ca587ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:29.915966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e31b-2951-4b6d-a6db-0ec90ca587ef admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:29.916254 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e31b-2951-4b6d-a6db-0ec90ca587ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:29.916534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e31b-2951-4b6d-a6db-0ec90ca587ef admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:29.917239 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4e31b-2951-4b6d-a6db-0ec90ca587ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:29.919199 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4e31b-2951-4b6d-a6db-0ec90ca587ef admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:29.938788 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1424/2835] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:49:29 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:49:29.942733 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3ebea-cf0a-4d81-b57d-3950c9dca0c3 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:29.953677 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3ebea-cf0a-4d81-b57d-3950c9dca0c3 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:29.958400 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20f43e-1954-4cab-94cc-65c66f30e5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:29.959092 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f43e-1954-4cab-94cc-65c66f30e5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:29.959379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f43e-1954-4cab-94cc-65c66f30e5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:29.959665 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20f43e-1954-4cab-94cc-65c66f30e5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:29.960398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20f43e-1954-4cab-94cc-65c66f30e5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:29.962014 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20f43e-1954-4cab-94cc-65c66f30e5a5 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:29.973127 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1412/2836] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:29.977050 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4e31b-2951-4b6d-a6db-0ec90ca587ef admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:29.986833 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4e31b-2951-4b6d-a6db-0ec90ca587ef admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:29.991458 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4247f926-c59c-4dca-8ccf-5753c3f7e5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:29.992373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f926-c59c-4dca-8ccf-5753c3f7e5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:29.992657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f926-c59c-4dca-8ccf-5753c3f7e5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:29.992933 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4247f926-c59c-4dca-8ccf-5753c3f7e5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:29.993653 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247f926-c59c-4dca-8ccf-5753c3f7e5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:29.995283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4247f926-c59c-4dca-8ccf-5753c3f7e5d4 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:30.005502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1425/2837] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:30.009267 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20f43e-1954-4cab-94cc-65c66f30e5a5 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:30.019610 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20f43e-1954-4cab-94cc-65c66f30e5a5 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:30.024201 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d241d5-9141-4be7-9c58-6ad47669053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:30.025072 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d241d5-9141-4be7-9c58-6ad47669053b admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.025356 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d241d5-9141-4be7-9c58-6ad47669053b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.025636 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d241d5-9141-4be7-9c58-6ad47669053b admin admin] PATH_INFO: `/v3/projects/1cd9614365de496fb4befcb3434df41c/users/a31a77e5536e4b71a66a11572a6419f4/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.040708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d241d5-9141-4be7-9c58-6ad47669053b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd9614365de496fb4befcb3434df41c, user_id=a31a77e5536e4b71a66a11572a6419f4, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:30.043410 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d241d5-9141-4be7-9c58-6ad47669053b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:30.056749 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1413/2838] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:49:30 2022] PUT /identity/v3/projects/1cd9614365de496fb4befcb3434df41c/users/a31a77e5536e4b71a66a11572a6419f4/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:30.067718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d0503-3592-4a9c-b2a0-9a7af0e69a21 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.068016 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d0503-3592-4a9c-b2a0-9a7af0e69a21 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.068300 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d0503-3592-4a9c-b2a0-9a7af0e69a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.095655 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-6d9d0503-3592-4a9c-b2a0-9a7af0e69a21 None None] MFA Rules not processed for user `a31a77e5536e4b71a66a11572a6419f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:30.096873 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-6d9d0503-3592-4a9c-b2a0-9a7af0e69a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:30.163634 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1426/2839] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:30.167930 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d241d5-9141-4be7-9c58-6ad47669053b admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:30.226189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d241d5-9141-4be7-9c58-6ad47669053b admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:30.230769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2062fe-b113-4aca-af6f-66028d6eebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:30.231449 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2062fe-b113-4aca-af6f-66028d6eebbf admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.231731 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2062fe-b113-4aca-af6f-66028d6eebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.232032 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2062fe-b113-4aca-af6f-66028d6eebbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.233282 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2062fe-b113-4aca-af6f-66028d6eebbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:30.235189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2062fe-b113-4aca-af6f-66028d6eebbf admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:30.264049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1414/2840] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:49:30 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:30.268100 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d0503-3592-4a9c-b2a0-9a7af0e69a21 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:30.278580 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d0503-3592-4a9c-b2a0-9a7af0e69a21 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:30.331680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c83240-c906-42d8-af7a-f40de1625e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:30.332349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83240-c906-42d8-af7a-f40de1625e40 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.332630 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83240-c906-42d8-af7a-f40de1625e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.332902 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c83240-c906-42d8-af7a-f40de1625e40 admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.333593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c83240-c906-42d8-af7a-f40de1625e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:30.335539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c83240-c906-42d8-af7a-f40de1625e40 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:30.355370 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1427/2841] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:49:30 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:30.360322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2062fe-b113-4aca-af6f-66028d6eebbf admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:30.370838 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2062fe-b113-4aca-af6f-66028d6eebbf admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:30.375538 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532200d-1698-4085-a6da-962d47e1e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:30.376189 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532200d-1698-4085-a6da-962d47e1e5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.376471 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532200d-1698-4085-a6da-962d47e1e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.376747 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532200d-1698-4085-a6da-962d47e1e5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.377467 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532200d-1698-4085-a6da-962d47e1e5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:30.379103 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532200d-1698-4085-a6da-962d47e1e5ca admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:30.389301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1415/2842] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:30.393312 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c83240-c906-42d8-af7a-f40de1625e40 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:30.403559 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c83240-c906-42d8-af7a-f40de1625e40 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:30.408832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc194f-a2d6-479f-87ab-c6d43739f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:30.409705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc194f-a2d6-479f-87ab-c6d43739f870 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.409988 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc194f-a2d6-479f-87ab-c6d43739f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.410262 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc194f-a2d6-479f-87ab-c6d43739f870 admin admin] PATH_INFO: `/v3/projects/19bc7042277042378310c94d4074080b/users/67d960c1bd1b4950904e76d213a7f6da/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.425188 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc194f-a2d6-479f-87ab-c6d43739f870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bc7042277042378310c94d4074080b, user_id=67d960c1bd1b4950904e76d213a7f6da, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:30.427845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc194f-a2d6-479f-87ab-c6d43739f870 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:30.441279 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1428/2843] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:49:30 2022] PUT /identity/v3/projects/19bc7042277042378310c94d4074080b/users/67d960c1bd1b4950904e76d213a7f6da/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:30.445155 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532200d-1698-4085-a6da-962d47e1e5ca admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:30.455931 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532200d-1698-4085-a6da-962d47e1e5ca admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:30.509580 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81723c-8fe2-4f7c-9bb6-06ec548d8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:30.510240 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81723c-8fe2-4f7c-9bb6-06ec548d8534 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.510525 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81723c-8fe2-4f7c-9bb6-06ec548d8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.510801 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81723c-8fe2-4f7c-9bb6-06ec548d8534 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.511551 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81723c-8fe2-4f7c-9bb6-06ec548d8534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:30.513144 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81723c-8fe2-4f7c-9bb6-06ec548d8534 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:30.522469 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1416/2844] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:30.526690 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc194f-a2d6-479f-87ab-c6d43739f870 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:30.537490 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc194f-a2d6-479f-87ab-c6d43739f870 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:30.541989 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2a43f-75f2-4e1d-9d35-785067eeffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:30.542857 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2a43f-75f2-4e1d-9d35-785067eeffa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.543174 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2a43f-75f2-4e1d-9d35-785067eeffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.543446 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2a43f-75f2-4e1d-9d35-785067eeffa1 admin admin] PATH_INFO: `/v3/projects/19bc7042277042378310c94d4074080b/users/67d960c1bd1b4950904e76d213a7f6da/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.546912 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2a43f-75f2-4e1d-9d35-785067eeffa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19bc7042277042378310c94d4074080b, user_id=67d960c1bd1b4950904e76d213a7f6da, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:30.549585 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2a43f-75f2-4e1d-9d35-785067eeffa1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:30.559394 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1429/2845] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:49:30 2022] PUT /identity/v3/projects/19bc7042277042378310c94d4074080b/users/67d960c1bd1b4950904e76d213a7f6da/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:30.569578 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f56cbf-45c8-4b66-9b11-1e30110fd5a6 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.570047 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f56cbf-45c8-4b66-9b11-1e30110fd5a6 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.570150 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f56cbf-45c8-4b66-9b11-1e30110fd5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.603570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-c9f56cbf-45c8-4b66-9b11-1e30110fd5a6 None None] MFA Rules not processed for user `67d960c1bd1b4950904e76d213a7f6da`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:30.605330 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-c9f56cbf-45c8-4b66-9b11-1e30110fd5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:30.688183 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1417/2846] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:30.699464 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2a43f-75f2-4e1d-9d35-785067eeffa1 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:30.701698 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-bcc2a43f-75f2-4e1d-9d35-785067eeffa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:30.759349 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2a43f-75f2-4e1d-9d35-785067eeffa1 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:30.763047 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f776228-32d2-42e9-98e4-b9917d8a7716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:30.764285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f776228-32d2-42e9-98e4-b9917d8a7716 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.764567 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f776228-32d2-42e9-98e4-b9917d8a7716 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.764840 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f776228-32d2-42e9-98e4-b9917d8a7716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.773479 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f776228-32d2-42e9-98e4-b9917d8a7716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:30.774929 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f776228-32d2-42e9-98e4-b9917d8a7716 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:30.785143 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1430/2847] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:49:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:30.856552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f56cbf-45c8-4b66-9b11-1e30110fd5a6 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:30.866279 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f56cbf-45c8-4b66-9b11-1e30110fd5a6 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:30.870171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f92ed-b90c-4eda-a79c-1ffb765e7867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:30.870812 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f92ed-b90c-4eda-a79c-1ffb765e7867 service cinder] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:30.871129 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f92ed-b90c-4eda-a79c-1ffb765e7867 service cinder] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:30.871411 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f92ed-b90c-4eda-a79c-1ffb765e7867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:30.925273 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f92ed-b90c-4eda-a79c-1ffb765e7867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:30.926703 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f92ed-b90c-4eda-a79c-1ffb765e7867 service cinder] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:30.935866 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1418/2848] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:49:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:33.601675 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f776228-32d2-42e9-98e4-b9917d8a7716 service cinder] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:33.661375 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f776228-32d2-42e9-98e4-b9917d8a7716 service cinder] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:33.665790 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:33.666650 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:33.666931 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:33.667232 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] PATH_INFO: `/v3/users/a31a77e5536e4b71a66a11572a6419f4` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:33.668404 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31a77e5536e4b71a66a11572a6419f4)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:33.671105 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:33.715411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31a77e5536e4b71a66a11572a6419f4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:33.721940 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31a77e5536e4b71a66a11572a6419f4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:33.722599 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31a77e5536e4b71a66a11572a6419f4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:33.723230 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31a77e5536e4b71a66a11572a6419f4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:33.734889 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31a77e5536e4b71a66a11572a6419f4'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:33.746892 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1431/2849] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:49:33 2022] DELETE /identity/v3/users/a31a77e5536e4b71a66a11572a6419f4 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:33.751999 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a661c6-5a6b-41b9-8922-7b6c33851bcd None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:33.752486 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a661c6-5a6b-41b9-8922-7b6c33851bcd None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:33.752593 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a661c6-5a6b-41b9-8922-7b6c33851bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:33.769576 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-54a661c6-5a6b-41b9-8922-7b6c33851bcd None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:33.770782 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-54a661c6-5a6b-41b9-8922-7b6c33851bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:33.827407 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1419/2850] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:33.836856 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:33.838250 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:33.894431 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ae9d9-f7aa-4a72-b91f-8b7478bb585a admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:33.898121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d4e35-22a8-4ed2-a194-a86b3a82295f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:33.898765 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d4e35-22a8-4ed2-a194-a86b3a82295f service neutron] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:33.899074 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d4e35-22a8-4ed2-a194-a86b3a82295f service neutron] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:33.899355 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d4e35-22a8-4ed2-a194-a86b3a82295f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:33.908907 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d4e35-22a8-4ed2-a194-a86b3a82295f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:33.910338 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d4e35-22a8-4ed2-a194-a86b3a82295f service neutron] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:33.920267 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1432/2851] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:34.181134 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a661c6-5a6b-41b9-8922-7b6c33851bcd None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:34.182616 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-54a661c6-5a6b-41b9-8922-7b6c33851bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:34.194664 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a661c6-5a6b-41b9-8922-7b6c33851bcd None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:34.199312 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:34.200167 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:34.200456 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:34.200858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] PATH_INFO: `/v3/projects/1cd9614365de496fb4befcb3434df41c` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:34.202052 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd9614365de496fb4befcb3434df41c)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:34.203996 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:34.249654 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd9614365de496fb4befcb3434df41c', 'request_id': 'req-a7748f64-927c-4e47-83cc-ff6544b3cfcb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.255624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd9614365de496fb4befcb3434df41c', 'request_id': 'req-a7748f64-927c-4e47-83cc-ff6544b3cfcb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.260889 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd9614365de496fb4befcb3434df41c', 'request_id': 'req-a7748f64-927c-4e47-83cc-ff6544b3cfcb'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.271894 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] The token cache is being invalidate because project 1cd9614365de496fb4befcb3434df41c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:34.272122 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.272745 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.274268 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1420/2852] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:49:34 2022] DELETE /identity/v3/projects/1cd9614365de496fb4befcb3434df41c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:34.279884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d4e35-22a8-4ed2-a194-a86b3a82295f service neutron] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:34.289639 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d4e35-22a8-4ed2-a194-a86b3a82295f service neutron] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:34.343010 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:34.343884 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:34.344163 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:34.344434 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] PATH_INFO: `/v3/users/67d960c1bd1b4950904e76d213a7f6da` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:34.345604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d960c1bd1b4950904e76d213a7f6da)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:34.347555 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:34.390039 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d960c1bd1b4950904e76d213a7f6da'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.396529 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d960c1bd1b4950904e76d213a7f6da'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.397231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d960c1bd1b4950904e76d213a7f6da'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.397872 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d960c1bd1b4950904e76d213a7f6da'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.409968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7f88057-7b42-4077-a75f-cb1636a67d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d960c1bd1b4950904e76d213a7f6da'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.421631 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1433/2853] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:49:34 2022] DELETE /identity/v3/users/67d960c1bd1b4950904e76d213a7f6da => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:34.680221 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:34.681740 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:34.695631 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7748f64-927c-4e47-83cc-ff6544b3cfcb admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:34.752301 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:34.753154 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:34.753434 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:34.753708 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] PATH_INFO: `/v3/projects/19bc7042277042378310c94d4074080b` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:34.754909 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19bc7042277042378310c94d4074080b)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:34.756846 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:34.800118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19bc7042277042378310c94d4074080b', 'request_id': 'req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.805986 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19bc7042277042378310c94d4074080b', 'request_id': 'req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.811592 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19bc7042277042378310c94d4074080b', 'request_id': 'req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.822923 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] The token cache is being invalidate because project 19bc7042277042378310c94d4074080b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79922) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:34.823238 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.823854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-cd5d9437-1ddc-4450-97f9-9dc3bddc090b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:34.825406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1421/2854] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:49:34 2022] DELETE /identity/v3/projects/19bc7042277042378310c94d4074080b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:34.830859 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616fd2-b8b5-4374-8d2e-243fc0a9fb2e None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:34.831390 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616fd2-b8b5-4374-8d2e-243fc0a9fb2e None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:34.831498 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2616fd2-b8b5-4374-8d2e-243fc0a9fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:34.849356 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-f2616fd2-b8b5-4374-8d2e-243fc0a9fb2e None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:34.850553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f2616fd2-b8b5-4374-8d2e-243fc0a9fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:34.906811 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1434/2855] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:34.914691 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2f2c-d23e-478a-85f1-8b0b93e5c9b8 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:34.914979 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2f2c-d23e-478a-85f1-8b0b93e5c9b8 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:34.915283 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c2f2c-d23e-478a-85f1-8b0b93e5c9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:34.932854 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-e48c2f2c-d23e-478a-85f1-8b0b93e5c9b8 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:34.934037 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e48c2f2c-d23e-478a-85f1-8b0b93e5c9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:34.942398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1422/2856] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:34.946537 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2616fd2-b8b5-4374-8d2e-243fc0a9fb2e None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:34.956724 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2616fd2-b8b5-4374-8d2e-243fc0a9fb2e None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:34.961249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b115d9c-4452-4746-82ae-6124bdb0fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:34.961896 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115d9c-4452-4746-82ae-6124bdb0fc3c admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:34.962177 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115d9c-4452-4746-82ae-6124bdb0fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:34.962453 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b115d9c-4452-4746-82ae-6124bdb0fc3c admin admin] PATH_INFO: `/v3/domains` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:34.963208 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b115d9c-4452-4746-82ae-6124bdb0fc3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79923) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:49:34.963516 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b115d9c-4452-4746-82ae-6124bdb0fc3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:34.965635 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b115d9c-4452-4746-82ae-6124bdb0fc3c admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:34.976522 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1435/2857] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:49:34.980829 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c2f2c-d23e-478a-85f1-8b0b93e5c9b8 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:34.989917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c2f2c-d23e-478a-85f1-8b0b93e5c9b8 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:34.994730 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb5a3e-7892-41b6-bd92-7152f767a651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:34.995431 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5a3e-7892-41b6-bd92-7152f767a651 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:34.995712 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5a3e-7892-41b6-bd92-7152f767a651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:34.995988 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb5a3e-7892-41b6-bd92-7152f767a651 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:34.996684 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb5a3e-7892-41b6-bd92-7152f767a651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:34.999188 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb5a3e-7892-41b6-bd92-7152f767a651 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.023824 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1423/2858] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:49:34 2022] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:49:35.027885 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b115d9c-4452-4746-82ae-6124bdb0fc3c admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.037785 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b115d9c-4452-4746-82ae-6124bdb0fc3c admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.092616 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8d1cb-fb12-4b89-94d0-ef7b58fbf56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.093278 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d1cb-fb12-4b89-94d0-ef7b58fbf56d admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.093562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d1cb-fb12-4b89-94d0-ef7b58fbf56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.093840 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8d1cb-fb12-4b89-94d0-ef7b58fbf56d admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.094531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8d1cb-fb12-4b89-94d0-ef7b58fbf56d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.096475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8d1cb-fb12-4b89-94d0-ef7b58fbf56d admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.115229 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1436/2859] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:49:35 2022] POST /identity/v3/users => generated 295 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:35.119564 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb5a3e-7892-41b6-bd92-7152f767a651 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.130172 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb5a3e-7892-41b6-bd92-7152f767a651 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.134711 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125fec5-b95c-4532-bcb7-a4b256357509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.135401 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125fec5-b95c-4532-bcb7-a4b256357509 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.135680 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125fec5-b95c-4532-bcb7-a4b256357509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.135951 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125fec5-b95c-4532-bcb7-a4b256357509 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.136667 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125fec5-b95c-4532-bcb7-a4b256357509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.138253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d125fec5-b95c-4532-bcb7-a4b256357509 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.148313 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1424/2860] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:35.152030 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8d1cb-fb12-4b89-94d0-ef7b58fbf56d admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.161843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8d1cb-fb12-4b89-94d0-ef7b58fbf56d admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.166502 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194a748-523f-4dcf-a39f-3f95b38e239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.167185 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194a748-523f-4dcf-a39f-3f95b38e239e admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.167471 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194a748-523f-4dcf-a39f-3f95b38e239e admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.167749 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194a748-523f-4dcf-a39f-3f95b38e239e admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.168472 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194a748-523f-4dcf-a39f-3f95b38e239e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.170601 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194a748-523f-4dcf-a39f-3f95b38e239e admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.180205 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1437/2861] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:35.184225 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125fec5-b95c-4532-bcb7-a4b256357509 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.194368 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d125fec5-b95c-4532-bcb7-a4b256357509 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.198893 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471752-499c-4223-8f59-8b63e97522dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.199783 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471752-499c-4223-8f59-8b63e97522dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.200067 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471752-499c-4223-8f59-8b63e97522dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.200345 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92471752-499c-4223-8f59-8b63e97522dc admin admin] PATH_INFO: `/v3/projects/655d83e30ac04ef4a3e93f506815fd85/users/aa13428fe5a0431e8393f5ac0c9ba08f/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.214397 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92471752-499c-4223-8f59-8b63e97522dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=655d83e30ac04ef4a3e93f506815fd85, user_id=aa13428fe5a0431e8393f5ac0c9ba08f, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.217169 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92471752-499c-4223-8f59-8b63e97522dc admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.229519 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1425/2862] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:49:35 2022] PUT /identity/v3/projects/655d83e30ac04ef4a3e93f506815fd85/users/aa13428fe5a0431e8393f5ac0c9ba08f/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:35.288201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db8b37-1073-4f3e-83c0-ada7f0fc9dbb None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.288488 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db8b37-1073-4f3e-83c0-ada7f0fc9dbb None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.288797 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db8b37-1073-4f3e-83c0-ada7f0fc9dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.315534 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-b6db8b37-1073-4f3e-83c0-ada7f0fc9dbb None None] MFA Rules not processed for user `aa13428fe5a0431e8393f5ac0c9ba08f`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:35.316747 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-b6db8b37-1073-4f3e-83c0-ada7f0fc9dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:35.379007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1438/2863] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:35.383382 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471752-499c-4223-8f59-8b63e97522dc admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.441758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92471752-499c-4223-8f59-8b63e97522dc admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.446488 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c63236-39af-433d-8d06-54e38e3a5a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.447171 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63236-39af-433d-8d06-54e38e3a5a12 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.447454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63236-39af-433d-8d06-54e38e3a5a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.447726 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63236-39af-433d-8d06-54e38e3a5a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.448417 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c63236-39af-433d-8d06-54e38e3a5a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.450303 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c63236-39af-433d-8d06-54e38e3a5a12 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.474935 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1426/2864] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:49:35 2022] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:35.478892 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db8b37-1073-4f3e-83c0-ada7f0fc9dbb None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.490053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db8b37-1073-4f3e-83c0-ada7f0fc9dbb None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.542913 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f7e53-d6e2-4967-b41f-7cf09b06745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.543596 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f7e53-d6e2-4967-b41f-7cf09b06745f admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.543875 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f7e53-d6e2-4967-b41f-7cf09b06745f admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.544150 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f7e53-d6e2-4967-b41f-7cf09b06745f admin admin] PATH_INFO: `/v3/users` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.545439 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f7e53-d6e2-4967-b41f-7cf09b06745f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.547373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f7e53-d6e2-4967-b41f-7cf09b06745f admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.566378 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1439/2865] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:49:35 2022] POST /identity/v3/users => generated 301 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:35.570383 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c63236-39af-433d-8d06-54e38e3a5a12 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.580774 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c63236-39af-433d-8d06-54e38e3a5a12 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.585371 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118e0a6-0812-41c4-909b-41cbd4ef8329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.586026 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118e0a6-0812-41c4-909b-41cbd4ef8329 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.586331 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118e0a6-0812-41c4-909b-41cbd4ef8329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.586598 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118e0a6-0812-41c4-909b-41cbd4ef8329 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.587365 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118e0a6-0812-41c4-909b-41cbd4ef8329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.588981 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118e0a6-0812-41c4-909b-41cbd4ef8329 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.599917 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1427/2866] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:35.603810 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f7e53-d6e2-4967-b41f-7cf09b06745f admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.614359 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f7e53-d6e2-4967-b41f-7cf09b06745f admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.619224 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da95a0-f1f5-42f8-a078-d16b54b59a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.620154 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da95a0-f1f5-42f8-a078-d16b54b59a89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.620442 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da95a0-f1f5-42f8-a078-d16b54b59a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.620716 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da95a0-f1f5-42f8-a078-d16b54b59a89 admin admin] PATH_INFO: `/v3/projects/ea233ecab34d422eb6f8495c84967e92/users/bb0239d417bc4de48df70480dbdd57a1/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.634888 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da95a0-f1f5-42f8-a078-d16b54b59a89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea233ecab34d422eb6f8495c84967e92, user_id=bb0239d417bc4de48df70480dbdd57a1, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.637531 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da95a0-f1f5-42f8-a078-d16b54b59a89 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.649968 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1440/2867] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:49:35 2022] PUT /identity/v3/projects/ea233ecab34d422eb6f8495c84967e92/users/bb0239d417bc4de48df70480dbdd57a1/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:35.654358 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118e0a6-0812-41c4-909b-41cbd4ef8329 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.665462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118e0a6-0812-41c4-909b-41cbd4ef8329 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.719173 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd994c-1b37-4bb6-8928-526256b5ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.719874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd994c-1b37-4bb6-8928-526256b5ceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.720160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd994c-1b37-4bb6-8928-526256b5ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.720439 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd994c-1b37-4bb6-8928-526256b5ceb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.721192 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd994c-1b37-4bb6-8928-526256b5ceb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.722819 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd994c-1b37-4bb6-8928-526256b5ceb0 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.733134 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1428/2868] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:35.737419 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da95a0-f1f5-42f8-a078-d16b54b59a89 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.747818 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da95a0-f1f5-42f8-a078-d16b54b59a89 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.752271 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0f5f-bd90-4b12-9423-aa83bf413bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.753138 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0f5f-bd90-4b12-9423-aa83bf413bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.753418 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0f5f-bd90-4b12-9423-aa83bf413bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.753687 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0f5f-bd90-4b12-9423-aa83bf413bd7 admin admin] PATH_INFO: `/v3/projects/ea233ecab34d422eb6f8495c84967e92/users/bb0239d417bc4de48df70480dbdd57a1/roles/02a0298a908048b98fa7cc654a4dd57a` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.755672 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c0f5f-bd90-4b12-9423-aa83bf413bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea233ecab34d422eb6f8495c84967e92, user_id=bb0239d417bc4de48df70480dbdd57a1, role_id=02a0298a908048b98fa7cc654a4dd57a)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.758332 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c0f5f-bd90-4b12-9423-aa83bf413bd7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.768491 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1441/2869] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:49:35 2022] PUT /identity/v3/projects/ea233ecab34d422eb6f8495c84967e92/users/bb0239d417bc4de48df70480dbdd57a1/roles/02a0298a908048b98fa7cc654a4dd57a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:35.778678 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41498694-f281-4cf6-88ce-3851746804ed None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.779721 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41498694-f281-4cf6-88ce-3851746804ed None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.779852 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41498694-f281-4cf6-88ce-3851746804ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.805539 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-41498694-f281-4cf6-88ce-3851746804ed None None] MFA Rules not processed for user `bb0239d417bc4de48df70480dbdd57a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:35.806725 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-41498694-f281-4cf6-88ce-3851746804ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:35.871908 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1429/2870] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:35.882562 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0f5f-bd90-4b12-9423-aa83bf413bd7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:35.884249 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-f02c0f5f-bd90-4b12-9423-aa83bf413bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:35.939090 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0f5f-bd90-4b12-9423-aa83bf413bd7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:35.942708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526db6-80bb-49fc-a648-836f4d41ee15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:35.943382 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526db6-80bb-49fc-a648-836f4d41ee15 service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:35.943668 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526db6-80bb-49fc-a648-836f4d41ee15 service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:35.943946 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526db6-80bb-49fc-a648-836f4d41ee15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:35.953380 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87526db6-80bb-49fc-a648-836f4d41ee15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:35.954803 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87526db6-80bb-49fc-a648-836f4d41ee15 service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:35.964252 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1442/2871] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:49:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:36.088242 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41498694-f281-4cf6-88ce-3851746804ed None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.147836 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41498694-f281-4cf6-88ce-3851746804ed None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.152357 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.153219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.153504 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.153785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] PATH_INFO: `/v3/users/aa13428fe5a0431e8393f5ac0c9ba08f` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.155634 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa13428fe5a0431e8393f5ac0c9ba08f)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.157570 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.201510 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa13428fe5a0431e8393f5ac0c9ba08f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.202101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa13428fe5a0431e8393f5ac0c9ba08f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.208670 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa13428fe5a0431e8393f5ac0c9ba08f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.209307 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa13428fe5a0431e8393f5ac0c9ba08f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.217142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa13428fe5a0431e8393f5ac0c9ba08f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.233833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1430/2872] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:49:36 2022] DELETE /identity/v3/users/aa13428fe5a0431e8393f5ac0c9ba08f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:36.238420 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f20cc-fa9c-4639-b57f-857df0de7efa None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.238746 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f20cc-fa9c-4639-b57f-857df0de7efa None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.239053 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f20cc-fa9c-4639-b57f-857df0de7efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.257012 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-461f20cc-fa9c-4639-b57f-857df0de7efa None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:36.258218 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-461f20cc-fa9c-4639-b57f-857df0de7efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:36.314035 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1443/2873] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:36.323547 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.324941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:36.389327 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390b638-7910-4ce6-82b5-a34a0da25e07 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.392952 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71d801-d71c-4f32-848e-db868639080d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.393594 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71d801-d71c-4f32-848e-db868639080d service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.393878 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71d801-d71c-4f32-848e-db868639080d service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.394160 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71d801-d71c-4f32-848e-db868639080d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.402929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71d801-d71c-4f32-848e-db868639080d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.404409 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71d801-d71c-4f32-848e-db868639080d service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.413600 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1431/2874] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:36.676007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f20cc-fa9c-4639-b57f-857df0de7efa None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.677424 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-461f20cc-fa9c-4639-b57f-857df0de7efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:36.690680 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f20cc-fa9c-4639-b57f-857df0de7efa None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.695270 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.696132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.696416 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.696691 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] PATH_INFO: `/v3/projects/655d83e30ac04ef4a3e93f506815fd85` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.697879 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=655d83e30ac04ef4a3e93f506815fd85)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.699845 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.744492 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655d83e30ac04ef4a3e93f506815fd85', 'request_id': 'req-bb38d721-0113-4fba-bc80-76d557102fce'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.751851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655d83e30ac04ef4a3e93f506815fd85', 'request_id': 'req-bb38d721-0113-4fba-bc80-76d557102fce'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.757285 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655d83e30ac04ef4a3e93f506815fd85', 'request_id': 'req-bb38d721-0113-4fba-bc80-76d557102fce'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.767833 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] The token cache is being invalidate because project 655d83e30ac04ef4a3e93f506815fd85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:36.768121 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.768753 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.770293 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1444/2875] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:49:36 2022] DELETE /identity/v3/projects/655d83e30ac04ef4a3e93f506815fd85 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:36.774335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71d801-d71c-4f32-848e-db868639080d service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:36.783864 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71d801-d71c-4f32-848e-db868639080d service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:36.838874 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:36.839772 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:36.840058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:36.840335 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] PATH_INFO: `/v3/users/bb0239d417bc4de48df70480dbdd57a1` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:36.841523 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0239d417bc4de48df70480dbdd57a1)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:36.843487 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:36.888005 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0239d417bc4de48df70480dbdd57a1'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.888658 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0239d417bc4de48df70480dbdd57a1'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.895127 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0239d417bc4de48df70480dbdd57a1'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.895752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0239d417bc4de48df70480dbdd57a1'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.902552 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-4da5534a-7a13-4386-a36f-1777c3e35911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0239d417bc4de48df70480dbdd57a1'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:36.920294 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1432/2876] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:49:36 2022] DELETE /identity/v3/users/bb0239d417bc4de48df70480dbdd57a1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:49:37.179851 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.181291 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:37.195398 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38d721-0113-4fba-bc80-76d557102fce admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.253054 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.253915 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.254201 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.254480 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] PATH_INFO: `/v3/projects/ea233ecab34d422eb6f8495c84967e92` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.255677 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea233ecab34d422eb6f8495c84967e92)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.257591 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.304007 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea233ecab34d422eb6f8495c84967e92', 'request_id': 'req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:37.310737 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea233ecab34d422eb6f8495c84967e92', 'request_id': 'req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:37.316108 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea233ecab34d422eb6f8495c84967e92', 'request_id': 'req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:37.327322 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] The token cache is being invalidate because project ea233ecab34d422eb6f8495c84967e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:37.327611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:37.328237 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-0fee3fb7-3843-4de7-9167-02f1ff5ffec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:37.329966 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1445/2877] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:49:37 2022] DELETE /identity/v3/projects/ea233ecab34d422eb6f8495c84967e92 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:37.334802 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a850a-1bbc-436f-a66d-82ab718f3008 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.335118 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a850a-1bbc-436f-a66d-82ab718f3008 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.335402 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a850a-1bbc-436f-a66d-82ab718f3008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.353845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-8a9a850a-1bbc-436f-a66d-82ab718f3008 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:37.355088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-8a9a850a-1bbc-436f-a66d-82ab718f3008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:37.412322 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1433/2878] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:37.421129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739a1a-53da-434e-9bc2-cc1c1adcef95 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.421423 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739a1a-53da-434e-9bc2-cc1c1adcef95 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.421708 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739a1a-53da-434e-9bc2-cc1c1adcef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.439553 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-97739a1a-53da-434e-9bc2-cc1c1adcef95 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:37.440775 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-97739a1a-53da-434e-9bc2-cc1c1adcef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:37.448820 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1446/2879] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:37.453501 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a850a-1bbc-436f-a66d-82ab718f3008 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.463101 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a850a-1bbc-436f-a66d-82ab718f3008 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.468236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3898dfb-6ead-4fde-9f52-a0e07b788139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.468886 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898dfb-6ead-4fde-9f52-a0e07b788139 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.469166 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898dfb-6ead-4fde-9f52-a0e07b788139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.469440 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3898dfb-6ead-4fde-9f52-a0e07b788139 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.470182 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3898dfb-6ead-4fde-9f52-a0e07b788139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:49:37.470482 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3898dfb-6ead-4fde-9f52-a0e07b788139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.472090 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3898dfb-6ead-4fde-9f52-a0e07b788139 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.483441 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1434/2880] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:49:37.488320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97739a1a-53da-434e-9bc2-cc1c1adcef95 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.497604 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97739a1a-53da-434e-9bc2-cc1c1adcef95 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.502160 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112e251-f19e-4ce1-b71c-d1d2067f1ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.502800 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112e251-f19e-4ce1-b71c-d1d2067f1ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.503116 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112e251-f19e-4ce1-b71c-d1d2067f1ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.503396 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112e251-f19e-4ce1-b71c-d1d2067f1ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.504079 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112e251-f19e-4ce1-b71c-d1d2067f1ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.505976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112e251-f19e-4ce1-b71c-d1d2067f1ca1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.532799 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1447/2881] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:49:37 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 12 14:49:37.535252 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3898dfb-6ead-4fde-9f52-a0e07b788139 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.544954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3898dfb-6ead-4fde-9f52-a0e07b788139 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.598954 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc2979-0922-49af-b647-0bff57c2d420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.599655 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc2979-0922-49af-b647-0bff57c2d420 admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.599939 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc2979-0922-49af-b647-0bff57c2d420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.600247 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc2979-0922-49af-b647-0bff57c2d420 admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.600929 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc2979-0922-49af-b647-0bff57c2d420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.602835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc2979-0922-49af-b647-0bff57c2d420 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.621349 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1435/2882] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:49:37 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:37.625449 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112e251-f19e-4ce1-b71c-d1d2067f1ca1 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.635612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112e251-f19e-4ce1-b71c-d1d2067f1ca1 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.640711 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7faaf-1c6b-462f-acc5-7d1aaa5d6e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.641361 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7faaf-1c6b-462f-acc5-7d1aaa5d6e19 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.641645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7faaf-1c6b-462f-acc5-7d1aaa5d6e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.641920 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7faaf-1c6b-462f-acc5-7d1aaa5d6e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.642645 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7faaf-1c6b-462f-acc5-7d1aaa5d6e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.644283 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7faaf-1c6b-462f-acc5-7d1aaa5d6e19 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.655838 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1448/2883] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:37.659833 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc2979-0922-49af-b647-0bff57c2d420 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.669561 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc2979-0922-49af-b647-0bff57c2d420 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.674142 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223da8-db77-46f1-bf56-8658f8575c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.674792 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223da8-db77-46f1-bf56-8658f8575c7a admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.675105 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223da8-db77-46f1-bf56-8658f8575c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.675385 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223da8-db77-46f1-bf56-8658f8575c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.676106 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b223da8-db77-46f1-bf56-8658f8575c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.677682 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b223da8-db77-46f1-bf56-8658f8575c7a admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.687787 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1436/2884] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:37.691778 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7faaf-1c6b-462f-acc5-7d1aaa5d6e19 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.702232 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7faaf-1c6b-462f-acc5-7d1aaa5d6e19 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.706927 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28196049-5795-437b-bdb4-447baabb3aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.707835 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196049-5795-437b-bdb4-447baabb3aca admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.708118 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196049-5795-437b-bdb4-447baabb3aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.708405 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196049-5795-437b-bdb4-447baabb3aca admin admin] PATH_INFO: `/v3/projects/83ebab85e1a745bd8a05557b2e69d3bd/users/a4b3592b6315408d960d85d8e38fc92f/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.722843 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28196049-5795-437b-bdb4-447baabb3aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ebab85e1a745bd8a05557b2e69d3bd, user_id=a4b3592b6315408d960d85d8e38fc92f, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.725530 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28196049-5795-437b-bdb4-447baabb3aca admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.738089 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1449/2885] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:49:37 2022] PUT /identity/v3/projects/83ebab85e1a745bd8a05557b2e69d3bd/users/a4b3592b6315408d960d85d8e38fc92f/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:37.749474 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9755a-2d33-4635-b925-652b23b69590 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.749765 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9755a-2d33-4635-b925-652b23b69590 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.750045 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9755a-2d33-4635-b925-652b23b69590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.776246 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-d5e9755a-2d33-4635-b925-652b23b69590 None None] MFA Rules not processed for user `a4b3592b6315408d960d85d8e38fc92f`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:37.777452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-d5e9755a-2d33-4635-b925-652b23b69590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:37.838236 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1437/2886] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:37.848877 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28196049-5795-437b-bdb4-447baabb3aca admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:37.850622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-28196049-5795-437b-bdb4-447baabb3aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:37.906726 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28196049-5795-437b-bdb4-447baabb3aca admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:37.910377 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fd137-bd71-4d56-ba34-bc65bd7a4cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe18e038b414ef0956a4e8a86586b88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:37.911015 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fd137-bd71-4d56-ba34-bc65bd7a4cdc service cinder] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:37.911330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fd137-bd71-4d56-ba34-bc65bd7a4cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:37.911607 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fd137-bd71-4d56-ba34-bc65bd7a4cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:37.919953 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fd137-bd71-4d56-ba34-bc65bd7a4cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:37.921389 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fd137-bd71-4d56-ba34-bc65bd7a4cdc service cinder] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:37.930320 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1450/2887] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:46.276994 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9755a-2d33-4635-b925-652b23b69590 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:46.336595 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9755a-2d33-4635-b925-652b23b69590 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:46.341191 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:46.342058 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:46.342343 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:46.342624 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] PATH_INFO: `/v3/users/a4b3592b6315408d960d85d8e38fc92f` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:46.343844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b3592b6315408d960d85d8e38fc92f)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:46.346353 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:46.397421 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b3592b6315408d960d85d8e38fc92f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:46.398111 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b3592b6315408d960d85d8e38fc92f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:46.407253 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b3592b6315408d960d85d8e38fc92f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:46.409936 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b3592b6315408d960d85d8e38fc92f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:46.417145 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b3592b6315408d960d85d8e38fc92f'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:46.434254 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1438/2888] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:49:46 2022] DELETE /identity/v3/users/a4b3592b6315408d960d85d8e38fc92f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 12 14:49:46.440187 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79911c37-f14a-4a52-bc78-e408cc99513c None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:46.440740 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79911c37-f14a-4a52-bc78-e408cc99513c None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:46.440740 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79911c37-f14a-4a52-bc78-e408cc99513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:46.457574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-79911c37-f14a-4a52-bc78-e408cc99513c None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:46.458828 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-79911c37-f14a-4a52-bc78-e408cc99513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:46.514587 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1451/2889] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:46.524049 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:46.525484 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:46.580355 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630e3f4-224d-4802-b43a-d80c701525c7 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:46.584011 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455c8b6-2ee8-430b-85d2-559387895410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:46.584650 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c8b6-2ee8-430b-85d2-559387895410 service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:46.584938 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c8b6-2ee8-430b-85d2-559387895410 service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:46.585219 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455c8b6-2ee8-430b-85d2-559387895410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:46.594586 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455c8b6-2ee8-430b-85d2-559387895410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:46.596038 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455c8b6-2ee8-430b-85d2-559387895410 service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:46.605387 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1439/2890] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:49:46.875990 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79911c37-f14a-4a52-bc78-e408cc99513c None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:46.877718 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-79911c37-f14a-4a52-bc78-e408cc99513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:46.894611 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79911c37-f14a-4a52-bc78-e408cc99513c None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:46.899893 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:46.900755 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:46.901129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:46.901306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] PATH_INFO: `/v3/projects/83ebab85e1a745bd8a05557b2e69d3bd` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:46.902612 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ebab85e1a745bd8a05557b2e69d3bd)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:46.904542 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:46.949565 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ebab85e1a745bd8a05557b2e69d3bd', 'request_id': 'req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:46.956705 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ebab85e1a745bd8a05557b2e69d3bd', 'request_id': 'req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:46.962219 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ebab85e1a745bd8a05557b2e69d3bd', 'request_id': 'req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:46.974029 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] The token cache is being invalidate because project 83ebab85e1a745bd8a05557b2e69d3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:49:46.974333 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:46.974972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-3e9a3aec-aa4f-41a4-a9b9-3b1c76671af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:49:46.976561 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1452/2891] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:49:46 2022] DELETE /identity/v3/projects/83ebab85e1a745bd8a05557b2e69d3bd => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:46.981512 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ba6d-de7d-4ce7-92fc-92c748e04736 None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:46.981835 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ba6d-de7d-4ce7-92fc-92c748e04736 None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:46.982116 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ba6d-de7d-4ce7-92fc-92c748e04736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:47.000004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-1557ba6d-de7d-4ce7-92fc-92c748e04736 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:47.001141 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-1557ba6d-de7d-4ce7-92fc-92c748e04736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:47.058406 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1440/2892] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 12 14:49:47.066097 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50121afc-54b6-4b77-9d7b-cb280dd909a5 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:47.066392 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50121afc-54b6-4b77-9d7b-cb280dd909a5 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:47.066676 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50121afc-54b6-4b77-9d7b-cb280dd909a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:47.087622 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-50121afc-54b6-4b77-9d7b-cb280dd909a5 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:47.088862 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-50121afc-54b6-4b77-9d7b-cb280dd909a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:47.108165 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1453/2893] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:47.112455 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ba6d-de7d-4ce7-92fc-92c748e04736 None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:47.122379 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ba6d-de7d-4ce7-92fc-92c748e04736 None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:47.126941 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887c129-4c59-4ee8-acfe-f73631147020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:47.127629 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887c129-4c59-4ee8-acfe-f73631147020 admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:47.127912 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887c129-4c59-4ee8-acfe-f73631147020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:47.128187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887c129-4c59-4ee8-acfe-f73631147020 admin admin] PATH_INFO: `/v3/domains` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:47.128944 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887c129-4c59-4ee8-acfe-f73631147020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79922) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 12 14:49:47.129256 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887c129-4c59-4ee8-acfe-f73631147020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:47.130882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887c129-4c59-4ee8-acfe-f73631147020 admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:47.142603 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1441/2894] 10.222.0.75 () {58 vars in 1152 bytes} [Thu May 12 14:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 12 14:49:47.146832 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50121afc-54b6-4b77-9d7b-cb280dd909a5 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:47.155880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50121afc-54b6-4b77-9d7b-cb280dd909a5 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:47.161198 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2da7d5-21f3-40b0-b49b-7ce2f576f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:47.161849 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2da7d5-21f3-40b0-b49b-7ce2f576f7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:47.162132 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2da7d5-21f3-40b0-b49b-7ce2f576f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:47.162411 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2da7d5-21f3-40b0-b49b-7ce2f576f7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:47.163155 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2da7d5-21f3-40b0-b49b-7ce2f576f7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:47.165259 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2da7d5-21f3-40b0-b49b-7ce2f576f7b7 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:47.190475 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1454/2895] 10.222.0.75 () {60 vars in 1152 bytes} [Thu May 12 14:49:47 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:47.194599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887c129-4c59-4ee8-acfe-f73631147020 admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:47.204483 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887c129-4c59-4ee8-acfe-f73631147020 admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:47.260004 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc55d0-fdb8-407b-aff7-618f0cde6cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:47.260599 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc55d0-fdb8-407b-aff7-618f0cde6cda admin admin] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:47.260882 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc55d0-fdb8-407b-aff7-618f0cde6cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:47.261177 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc55d0-fdb8-407b-aff7-618f0cde6cda admin admin] PATH_INFO: `/v3/users` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:47.262003 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc55d0-fdb8-407b-aff7-618f0cde6cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:47.263961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc55d0-fdb8-407b-aff7-618f0cde6cda admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:47.285704 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1442/2896] 10.222.0.75 () {60 vars in 1143 bytes} [Thu May 12 14:49:47 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 12 14:49:47.286819 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2da7d5-21f3-40b0-b49b-7ce2f576f7b7 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:47.296831 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2da7d5-21f3-40b0-b49b-7ce2f576f7b7 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:47.302241 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e001-465f-4369-ab2c-39418d7c6fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:47.302899 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e001-465f-4369-ab2c-39418d7c6fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:47.303223 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e001-465f-4369-ab2c-39418d7c6fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:47.303501 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e001-465f-4369-ab2c-39418d7c6fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:47.304231 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73e001-465f-4369-ab2c-39418d7c6fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:47.305833 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73e001-465f-4369-ab2c-39418d7c6fa1 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:47.316807 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1455/2897] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:47.320454 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc55d0-fdb8-407b-aff7-618f0cde6cda admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:47.330656 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc55d0-fdb8-407b-aff7-618f0cde6cda admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:47.335248 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca1e27-bfbe-4e2c-8d14-eb56a8db593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:47.335900 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1e27-bfbe-4e2c-8d14-eb56a8db593d admin admin] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:47.336187 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1e27-bfbe-4e2c-8d14-eb56a8db593d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:47.336465 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca1e27-bfbe-4e2c-8d14-eb56a8db593d admin admin] PATH_INFO: `/v3/roles` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:47.337203 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca1e27-bfbe-4e2c-8d14-eb56a8db593d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:47.338758 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca1e27-bfbe-4e2c-8d14-eb56a8db593d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:47.348785 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1443/2898] 10.222.0.75 () {58 vars in 1121 bytes} [Thu May 12 14:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 12 14:49:47.352657 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e001-465f-4369-ab2c-39418d7c6fa1 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:47.362129 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e001-465f-4369-ab2c-39418d7c6fa1 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:47.366976 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a13efd-edc3-404a-8dcb-5c734e2397f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:47.367880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a13efd-edc3-404a-8dcb-5c734e2397f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:47.368179 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a13efd-edc3-404a-8dcb-5c734e2397f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:47.368462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a13efd-edc3-404a-8dcb-5c734e2397f6 admin admin] PATH_INFO: `/v3/projects/687be8f4d23d4be5b0fa5cc769f1adcf/users/8f1ef7bae4f14808ad3524fa58a3dada/roles/2d441060f04441848c895dc5b9affb06` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:47.383104 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a13efd-edc3-404a-8dcb-5c734e2397f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=687be8f4d23d4be5b0fa5cc769f1adcf, user_id=8f1ef7bae4f14808ad3524fa58a3dada, role_id=2d441060f04441848c895dc5b9affb06)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:47.385774 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a13efd-edc3-404a-8dcb-5c734e2397f6 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:47.398880 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1456/2899] 10.222.0.75 () {60 vars in 1482 bytes} [Thu May 12 14:49:47 2022] PUT /identity/v3/projects/687be8f4d23d4be5b0fa5cc769f1adcf/users/8f1ef7bae4f14808ad3524fa58a3dada/roles/2d441060f04441848c895dc5b9affb06 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:49:47.410158 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fa1f5-9396-4d0d-812a-edbcc278332c None None] REQUEST_METHOD: `POST` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:47.410462 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fa1f5-9396-4d0d-812a-edbcc278332c None None] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:47.410769 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fa1f5-9396-4d0d-812a-edbcc278332c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:47.437088 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.auth.core [None req-e15fa1f5-9396-4d0d-812a-edbcc278332c None None] MFA Rules not processed for user `8f1ef7bae4f14808ad3524fa58a3dada`. Rule list: `[]` (Enabled: `True`). {{(pid=79922) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:49:47.438875 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-e15fa1f5-9396-4d0d-812a-edbcc278332c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:47.501198 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1444/2900] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:49:47.512795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a13efd-edc3-404a-8dcb-5c734e2397f6 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:49:47.514400 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-67a13efd-edc3-404a-8dcb-5c734e2397f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:49:47.588330 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a13efd-edc3-404a-8dcb-5c734e2397f6 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:49:47.591991 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64ec3-7f76-4397-97c6-39cb6db1573a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10414e35df26406786eaf49c52661cee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:49:47.592628 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64ec3-7f76-4397-97c6-39cb6db1573a service glance] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:49:47.592909 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64ec3-7f76-4397-97c6-39cb6db1573a service glance] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:49:47.593183 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64ec3-7f76-4397-97c6-39cb6db1573a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:49:47.601301 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64ec3-7f76-4397-97c6-39cb6db1573a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:49:47.602727 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64ec3-7f76-4397-97c6-39cb6db1573a service glance] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:49:47.611297 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1457/2901] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:50:20.390815 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fa1f5-9396-4d0d-812a-edbcc278332c None None] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:20.450398 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fa1f5-9396-4d0d-812a-edbcc278332c None None] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:20.454844 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:20.455767 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:20.456050 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:20.456318 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] PATH_INFO: `/v3/users/8f1ef7bae4f14808ad3524fa58a3dada` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:20.457517 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1ef7bae4f14808ad3524fa58a3dada)` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:20.459452 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:20.503608 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1ef7bae4f14808ad3524fa58a3dada'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:20.504850 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1ef7bae4f14808ad3524fa58a3dada'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:20.511384 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1ef7bae4f14808ad3524fa58a3dada'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:20.512070 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1ef7bae4f14808ad3524fa58a3dada'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:20.518961 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.notifications [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1ef7bae4f14808ad3524fa58a3dada'} {{(pid=79922) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:20.535423 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1445/2902] 10.222.0.75 () {58 vars in 1223 bytes} [Thu May 12 14:50:20 2022] DELETE /identity/v3/users/8f1ef7bae4f14808ad3524fa58a3dada => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:20.540064 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20307cee-f3d9-4002-8cde-fff6a38f2404 None None] REQUEST_METHOD: `POST` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:20.540593 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20307cee-f3d9-4002-8cde-fff6a38f2404 None None] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:20.540723 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20307cee-f3d9-4002-8cde-fff6a38f2404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:20.558081 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.auth.core [None req-20307cee-f3d9-4002-8cde-fff6a38f2404 None None] MFA Rules not processed for user `7c5460943950426d8cc84743272b5303`. Rule list: `[]` (Enabled: `True`). {{(pid=79923) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 12 14:50:20.559310 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-20307cee-f3d9-4002-8cde-fff6a38f2404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:20.614539 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1458/2903] 10.222.0.75 () {58 vars in 957 bytes} [Thu May 12 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 12 14:50:20.624520 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:20.625845 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:20.682184 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465be292-321a-44f1-b284-5af2c708b96d admin admin] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:20.685817 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395db13-3a75-49a8-84ca-ba59be404a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aca248c2e074fc4baff39930e21fe29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:20.686479 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395db13-3a75-49a8-84ca-ba59be404a9c service neutron] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:20.686766 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395db13-3a75-49a8-84ca-ba59be404a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:20.687051 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395db13-3a75-49a8-84ca-ba59be404a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:20.695980 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395db13-3a75-49a8-84ca-ba59be404a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:20.697445 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395db13-3a75-49a8-84ca-ba59be404a9c service neutron] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:20.706890 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1446/2904] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:50:20.965956 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20307cee-f3d9-4002-8cde-fff6a38f2404 None None] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:20.967435 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-20307cee-f3d9-4002-8cde-fff6a38f2404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:20.979629 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20307cee-f3d9-4002-8cde-fff6a38f2404 None None] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:20.984175 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c5460943950426d8cc84743272b5303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b51fa73b4d054aee9ce299da7ce9ee7a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:20.985026 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:20.985308 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:20.985584 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] PATH_INFO: `/v3/projects/687be8f4d23d4be5b0fa5cc769f1adcf` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:20.986767 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=687be8f4d23d4be5b0fa5cc769f1adcf)` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:20.989373 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:21.035153 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687be8f4d23d4be5b0fa5cc769f1adcf', 'request_id': 'req-d7e37ae6-8965-4a38-889b-7025a157c328'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:21.042504 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687be8f4d23d4be5b0fa5cc769f1adcf', 'request_id': 'req-d7e37ae6-8965-4a38-889b-7025a157c328'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:21.047874 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687be8f4d23d4be5b0fa5cc769f1adcf', 'request_id': 'req-d7e37ae6-8965-4a38-889b-7025a157c328'} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:21.058462 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] The token cache is being invalidate because project 687be8f4d23d4be5b0fa5cc769f1adcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79923) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 12 14:50:21.058752 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:21.059414 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.notifications [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79923) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 12 14:50:21.060972 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1459/2905] 10.222.0.75 () {58 vars in 1232 bytes} [Thu May 12 14:50:20 2022] DELETE /identity/v3/projects/687be8f4d23d4be5b0fa5cc769f1adcf => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 12 14:50:31.976360 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395db13-3a75-49a8-84ca-ba59be404a9c service neutron] Authenticating user token {{(pid=79922) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:50:31.977736 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-0395db13-3a75-49a8-84ca-ba59be404a9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:32.045024 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395db13-3a75-49a8-84ca-ba59be404a9c service neutron] Validating token access rules against request {{(pid=79922) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:50:32.101208 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835c035e-8fbd-4839-a43f-8ccb3919ddef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3004f3e4a9854502be59119e17e04961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79922) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:50:32.101858 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c035e-8fbd-4839-a43f-8ccb3919ddef service placement] REQUEST_METHOD: `GET` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:50:32.102148 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c035e-8fbd-4839-a43f-8ccb3919ddef service placement] SCRIPT_NAME: `/identity` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:50:32.102426 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c035e-8fbd-4839-a43f-8ccb3919ddef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79922) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:50:32.104227 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.fernet_utils [None req-835c035e-8fbd-4839-a43f-8ccb3919ddef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79922) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:50:32.116799 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c035e-8fbd-4839-a43f-8ccb3919ddef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:50:32.118752 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835c035e-8fbd-4839-a43f-8ccb3919ddef service placement] RBAC: Authorization granted {{(pid=79922) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:50:32.128720 dv-cinder-777031-14-iscsi devstack@keystone.service[79922]: [pid: 79922|app: 0|req: 1447/2906] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:50:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 12 14:55:37.054358 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] Authenticating user token {{(pid=79923) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 12 14:55:37.055854 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.fernet_utils [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79923) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 12 14:55:37.138614 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e37ae6-8965-4a38-889b-7025a157c328 admin admin] Validating token access rules against request {{(pid=79923) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 12 14:55:37.143618 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d5b17-74cb-422e-8e16-ae2c5e23b8cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3004f3e4a9854502be59119e17e04961', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1882b54135a443aca586cbb1d5c0e8f3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79923) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 12 14:55:37.144292 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5b17-74cb-422e-8e16-ae2c5e23b8cc service placement] REQUEST_METHOD: `GET` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 12 14:55:37.144574 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5b17-74cb-422e-8e16-ae2c5e23b8cc service placement] SCRIPT_NAME: `/identity` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 12 14:55:37.144852 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d5b17-74cb-422e-8e16-ae2c5e23b8cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79923) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 12 14:55:37.153306 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d5b17-74cb-422e-8e16-ae2c5e23b8cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 12 14:55:37.154895 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d5b17-74cb-422e-8e16-ae2c5e23b8cc service placement] RBAC: Authorization granted {{(pid=79923) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 12 14:55:37.165795 dv-cinder-777031-14-iscsi devstack@keystone.service[79923]: [pid: 79923|app: 0|req: 1460/2907] 10.222.0.75 () {60 vars in 1365 bytes} [Thu May 12 14:55:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)